[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:20 dist-test-slave-bw88 krb5kdc[27822](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:20 dist-test-slave-bw88 krb5kdc[27822](info): set up 2 sockets
Aug 10 06:40:20 dist-test-slave-bw88 krb5kdc[27822](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260810 06:40:21.307170 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:21 dist-test-slave-bw88 krb5kdc[27822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:40:21.430333 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:36337
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:36337
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:21.513711 27841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:21.513943 27841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:21.513981 27841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:21.515128 27841 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:21.515195 27841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:21.515223 27841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:21.515254 27841 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:21.515278 27841 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:21.516772 27841 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:36337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:36337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:21.517050 27841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:21.517282 27841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:21.522712 27849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:21.522801 27841 server_base.cc:1034] running on GCE node
W20260810 06:40:21.522740 27850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:21.522740 27852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:21.523145 27841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:21.523444 27841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:21.524605 27841 hybrid_clock.cc:648] HybridClock initialized: now 1786344021524636 us; error 84 us; skew 500 ppm
Aug 10 06:40:21 dist-test-slave-bw88 krb5kdc[27822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344021, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:21.527206 27841 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:40:21.527652 27841 webserver.cc:460] Webserver started at http://127.27.41.190:46589/ using document root <none> and password file <none>
I20260810 06:40:21.527925 27841 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:21.527990 27841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:21.528128 27841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:21.529285 27841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "f14e77f034b1462da26cda07d18f0f1c"
format_stamp: "Formatted at 2026-08-10 06:40:21 on dist-test-slave-bw88"
server_key: "cf3f9b78d8911da3330529d0a6ba1190"
server_key_iv: "ffe6bdd51f3bbad773585ca500474557"
server_key_version: "encryptionkey@0"
I20260810 06:40:21.529714 27841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "f14e77f034b1462da26cda07d18f0f1c"
format_stamp: "Formatted at 2026-08-10 06:40:21 on dist-test-slave-bw88"
server_key: "cf3f9b78d8911da3330529d0a6ba1190"
server_key_iv: "ffe6bdd51f3bbad773585ca500474557"
server_key_version: "encryptionkey@0"
I20260810 06:40:21.531093 27841 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:21.531804 27860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:21.531991 27841 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:21.532100 27841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "f14e77f034b1462da26cda07d18f0f1c"
format_stamp: "Formatted at 2026-08-10 06:40:21 on dist-test-slave-bw88"
server_key: "cf3f9b78d8911da3330529d0a6ba1190"
server_key_iv: "ffe6bdd51f3bbad773585ca500474557"
server_key_version: "encryptionkey@0"
I20260810 06:40:21.532171 27841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:21.554931 27841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:21.557000 27841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:21.557161 27841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:21.561355 27841 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:36337
I20260810 06:40:21.561437 27929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:36337 every 8 connection(s)
I20260810 06:40:21.561774 27841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:21.562672 27933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:21.565130 27933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c: Bootstrap starting.
I20260810 06:40:21.565692 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 27841
I20260810 06:40:21.565774 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:21.565841 27933 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:21.566143 27933 log.cc:824] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:21.566428 27814 external_mini_cluster.cc:1428] Setting key e515b152f2bb3789192f03fa8c903bba
I20260810 06:40:21.566972 27933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c: No bootstrap required, opened a new log
I20260810 06:40:21.569442 27933 raft_consensus.cc:348] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14e77f034b1462da26cda07d18f0f1c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 36337 } }
I20260810 06:40:21.569643 27933 raft_consensus.cc:374] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:21.569682 27933 raft_consensus.cc:729] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14e77f034b1462da26cda07d18f0f1c, State: Initialized, Role: FOLLOWER
I20260810 06:40:21.569815 27933 consensus_queue.cc:260] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14e77f034b1462da26cda07d18f0f1c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 36337 } }
I20260810 06:40:21.569898 27933 raft_consensus.cc:388] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:21.569931 27933 raft_consensus.cc:482] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:21.569979 27933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:21.571086 27933 raft_consensus.cc:504] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14e77f034b1462da26cda07d18f0f1c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 36337 } }
I20260810 06:40:21.571215 27933 leader_election.cc:302] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f14e77f034b1462da26cda07d18f0f1c; no voters:
I20260810 06:40:21.571391 27933 leader_election.cc:288] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:21.571421 27941 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:21.571588 27941 raft_consensus.cc:686] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [term 1 LEADER]: Becoming Leader. State: Replica: f14e77f034b1462da26cda07d18f0f1c, State: Running, Role: LEADER
I20260810 06:40:21.571660 27933 sys_catalog.cc:564] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:21.571712 27941 consensus_queue.cc:237] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14e77f034b1462da26cda07d18f0f1c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 36337 } }
I20260810 06:40:21.572058 27944 sys_catalog.cc:455] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f14e77f034b1462da26cda07d18f0f1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14e77f034b1462da26cda07d18f0f1c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 36337 } } }
I20260810 06:40:21.572050 27941 sys_catalog.cc:455] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f14e77f034b1462da26cda07d18f0f1c. Latest consensus state: current_term: 1 leader_uuid: "f14e77f034b1462da26cda07d18f0f1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14e77f034b1462da26cda07d18f0f1c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 36337 } } }
I20260810 06:40:21.572158 27944 sys_catalog.cc:458] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:21.572163 27941 sys_catalog.cc:458] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:21.572553 27950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:21.573185 27950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:21.576269 27950 catalog_manager.cc:1347] Generated new cluster ID: 1f5c208eb2894f3cb061de4ed7ec8512
I20260810 06:40:21.576327 27950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:40:21 dist-test-slave-bw88 krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:21.581897 27950 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:21.582595 27950 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:21.584313 27937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:21.567316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58570 (local address 127.27.41.190:36337)
0810 06:40:21.567472 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:21.567494 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:21.567868 (+ 374us) server_negotiation.cc:407] Connection header received
0810 06:40:21.570280 (+ 2412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:21.570286 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:21.570328 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:21.570440 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:21.572893 (+ 2453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:21.574263 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:21.575886 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:21.576424 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:21.576572 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:21.579934 (+ 3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:21.579939 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:21.579939 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:21.579955 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:21.582420 (+ 2465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:21.582914 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:21.582917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:21.582917 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:21.583014 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:21.583271 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:21.583272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:21.583273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:21.583491 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:21.583688 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:21.583945 (+ 257us) server_negotiation.cc:299] Negotiation successful
0810 06:40:21.584094 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":80,"threads_started":1}
I20260810 06:40:21.585594 27950 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f14e77f034b1462da26cda07d18f0f1c: Generated new TSK 0
I20260810 06:40:21.585750 27950 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:40:21.616060 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:36337
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:21.701258 27967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:21.701526 27967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:21.701555 27967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:21.702680 27967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:21.702718 27967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:21.702744 27967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:21.704150 27967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:36337
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:21.704336 27967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:21.704511 27967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:21.709599 27980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:21.709681 27975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:21.709642 27978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:21.709846 27967 server_base.cc:1034] running on GCE node
I20260810 06:40:21.710086 27967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:21.710317 27967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:21.711480 27967 hybrid_clock.cc:648] HybridClock initialized: now 1786344021711488 us; error 49 us; skew 500 ppm
Aug 10 06:40:21 dist-test-slave-bw88 krb5kdc[27822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344021, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:21.713974 27967 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:40:21.714453 27967 webserver.cc:460] Webserver started at http://127.27.41.129:46657/ using document root <none> and password file <none>
I20260810 06:40:21.714676 27967 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:21.714742 27967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:21.714888 27967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:21.715945 27967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "b3076939fb084394b02999028fd09752"
format_stamp: "Formatted at 2026-08-10 06:40:21 on dist-test-slave-bw88"
server_key: "bab4f3db383d2971a76f205e86b47a55"
server_key_iv: "807b39cd1bd533215d1c54f778df440d"
server_key_version: "encryptionkey@0"
I20260810 06:40:21.716320 27967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "b3076939fb084394b02999028fd09752"
format_stamp: "Formatted at 2026-08-10 06:40:21 on dist-test-slave-bw88"
server_key: "bab4f3db383d2971a76f205e86b47a55"
server_key_iv: "807b39cd1bd533215d1c54f778df440d"
server_key_version: "encryptionkey@0"
I20260810 06:40:21.717715 27967 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:40:21.718415 27988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:21.718581 27967 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:21.718703 27967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "b3076939fb084394b02999028fd09752"
format_stamp: "Formatted at 2026-08-10 06:40:21 on dist-test-slave-bw88"
server_key: "bab4f3db383d2971a76f205e86b47a55"
server_key_iv: "807b39cd1bd533215d1c54f778df440d"
server_key_version: "encryptionkey@0"
I20260810 06:40:21.718775 27967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:21.738008 27967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:21.739995 27967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:21.740156 27967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:21.740402 27967 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:21.740713 27967 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:21.740767 27967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:21.740808 27967 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:21.740839 27967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:21.747464 27967 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:45269
I20260810 06:40:21.747521 28135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:45269 every 8 connection(s)
I20260810 06:40:21.747826 27967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:40:21.751633 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 27967
I20260810 06:40:21.751711 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:40:21.751866 27814 external_mini_cluster.cc:1428] Setting key 909ed9f11217035b8d450a74ac9e507f
Aug 10 06:40:21 dist-test-slave-bw88 krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344021, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:21.757908 28138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:21.748631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:36337 (local address 127.27.41.129:55785)
0810 06:40:21.748809 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:21.748848 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:21.749407 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:21.749650 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:21.749653 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:21.750252 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:21.750450 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:21.750456 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:21.751152 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:21.751152 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:21.752064 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:21.752067 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:21.752530 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:21.752532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:21.752656 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:21.753170 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:21.753179 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:21.754614 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:21.756462 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:21.756469 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:21.756471 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:21.756697 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:21.756935 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:21.756936 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:21.756936 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:21.757039 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:21.757371 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:21.757378 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:21.757527 (+ 149us) client_negotiation.cc:769] Sending connection context
0810 06:40:21.757618 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 06:40:21.757744 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260810 06:40:21.757932 27937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:21.748630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:55785 (local address 127.27.41.190:36337)
0810 06:40:21.748687 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:21.748690 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:21.748934 (+ 244us) server_negotiation.cc:407] Connection header received
0810 06:40:21.749492 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:21.749493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:21.749504 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:21.749563 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:21.750534 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:21.751074 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:21.752145 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:21.752428 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:21.752493 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:21.754703 (+ 2210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:21.754705 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:21.754706 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:21.754714 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:21.756370 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:21.756773 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:21.756774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:21.756775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:21.756853 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:21.757104 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:21.757105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:21.757106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:21.757266 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:21.757365 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:21.757670 (+ 305us) server_negotiation.cc:299] Negotiation successful
0810 06:40:21.757787 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:40:21.758484 28136 heartbeater.cc:347] Connected to a master server at 127.27.41.190:36337
I20260810 06:40:21.758605 28136 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:21.758783 28136 heartbeater.cc:511] Master 127.27.41.190:36337 requested a full tablet report, sending...
I20260810 06:40:21.759315 27882 ts_manager.cc:194] Registered new tserver with Master: b3076939fb084394b02999028fd09752 (127.27.41.129:45269)
I20260810 06:40:21.759928 27882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:55785
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:40:21.779644 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:36337
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:21.862910 28141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:21.863158 28141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:21.863201 28141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:21.864348 28141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:21.864421 28141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:21.864466 28141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:21.865964 28141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:36337
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:21.866250 28141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:21.866487 28141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:21.871749 28148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:21.871768 28151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:21.871897 28141 server_base.cc:1034] running on GCE node
W20260810 06:40:21.871847 28149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:21.872495 28141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:21.872781 28141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:21.873941 28141 hybrid_clock.cc:648] HybridClock initialized: now 1786344021873931 us; error 35 us; skew 500 ppm
Aug 10 06:40:21 dist-test-slave-bw88 krb5kdc[27822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344021, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:21.876564 28141 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:40:21.876950 28141 webserver.cc:460] Webserver started at http://127.27.41.130:42617/ using document root <none> and password file <none>
I20260810 06:40:21.877156 28141 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:21.877197 28141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:21.877286 28141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:21.878371 28141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "dc7d584cd38c421db572b63c4d420a40"
format_stamp: "Formatted at 2026-08-10 06:40:21 on dist-test-slave-bw88"
server_key: "05c837d7db653c7b6270d6f1e30ec268"
server_key_iv: "23096aaec7564a921fac64e7c8d4b2b3"
server_key_version: "encryptionkey@0"
I20260810 06:40:21.878708 28141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "dc7d584cd38c421db572b63c4d420a40"
format_stamp: "Formatted at 2026-08-10 06:40:21 on dist-test-slave-bw88"
server_key: "05c837d7db653c7b6270d6f1e30ec268"
server_key_iv: "23096aaec7564a921fac64e7c8d4b2b3"
server_key_version: "encryptionkey@0"
I20260810 06:40:21.879971 28141 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:40:21.880658 28160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:21.880821 28141 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:21.880903 28141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "dc7d584cd38c421db572b63c4d420a40"
format_stamp: "Formatted at 2026-08-10 06:40:21 on dist-test-slave-bw88"
server_key: "05c837d7db653c7b6270d6f1e30ec268"
server_key_iv: "23096aaec7564a921fac64e7c8d4b2b3"
server_key_version: "encryptionkey@0"
I20260810 06:40:21.880959 28141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:21.889993 28141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:21.891746 28141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:21.891858 28141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:21.892041 28141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:21.892386 28141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:21.892421 28141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:21.892441 28141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:21.892452 28141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:21.898382 28141 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:37651
I20260810 06:40:21.898483 28315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:37651 every 8 connection(s)
I20260810 06:40:21.898787 28141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:40:21.904809 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 28141
Aug 10 06:40:21 dist-test-slave-bw88 krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344021, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:21.904942 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:40:21.905122 27814 external_mini_cluster.cc:1428] Setting key 2fe21dfdf14f1651485afcdbc924e842
I20260810 06:40:21.908528 27937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:21.899637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:54495 (local address 127.27.41.190:36337)
0810 06:40:21.899707 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:21.899710 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:21.899943 (+ 233us) server_negotiation.cc:407] Connection header received
0810 06:40:21.900430 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:21.900431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:21.900442 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:21.900497 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:21.901492 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:21.902011 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:21.902977 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:21.903161 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:21.903211 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:21.905445 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:21.905447 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:21.905447 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:21.905454 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:21.906958 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:21.907452 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:21.907453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:21.907453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:21.907554 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:21.907845 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:21.907846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:21.907846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:21.907994 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:21.908067 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:21.908306 (+ 239us) server_negotiation.cc:299] Negotiation successful
0810 06:40:21.908398 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 06:40:21.908553 28318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:21.899619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:36337 (local address 127.27.41.130:54495)
0810 06:40:21.899822 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:21.899864 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:21.900346 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:21.900565 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:21.900568 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:21.901149 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:21.901402 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:21.901410 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:21.902103 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:21.902104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:21.902904 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:21.902906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:21.903232 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:21.903232 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:21.903344 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:21.903795 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:21.903803 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:21.905316 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:21.907038 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:21.907046 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:21.907048 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:21.907378 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:21.907636 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:21.907637 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:21.907638 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:21.907780 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:21.908060 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:21.908065 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:21.908177 (+ 112us) client_negotiation.cc:769] Sending connection context
0810 06:40:21.908262 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 06:40:21.908380 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":108,"threads_started":1}
I20260810 06:40:21.909013 28316 heartbeater.cc:347] Connected to a master server at 127.27.41.190:36337
I20260810 06:40:21.909124 28316 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:21.909318 28316 heartbeater.cc:511] Master 127.27.41.190:36337 requested a full tablet report, sending...
I20260810 06:40:21.909723 27882 ts_manager.cc:194] Registered new tserver with Master: dc7d584cd38c421db572b63c4d420a40 (127.27.41.130:37651)
I20260810 06:40:21.910087 27882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:54495
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:40:21.931903 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:36337
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:22.018090 28321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:22.018294 28321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:22.018337 28321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:22.019459 28321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:22.019500 28321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:22.019554 28321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:22.021019 28321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:36337
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:22.021263 28321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:22.021507 28321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:22.026702 28330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:22.026696 28328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:22.026698 28332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:22.026726 28321 server_base.cc:1034] running on GCE node
I20260810 06:40:22.027172 28321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:22.027400 28321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:22.028563 28321 hybrid_clock.cc:648] HybridClock initialized: now 1786344022028558 us; error 36 us; skew 500 ppm
Aug 10 06:40:22 dist-test-slave-bw88 krb5kdc[27822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344022, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:22.031042 28321 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:40:22.031497 28321 webserver.cc:460] Webserver started at http://127.27.41.131:41173/ using document root <none> and password file <none>
I20260810 06:40:22.031690 28321 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:22.031733 28321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:22.031858 28321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:22.032905 28321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "55c64594ace54314844affce3b44f92e"
format_stamp: "Formatted at 2026-08-10 06:40:22 on dist-test-slave-bw88"
server_key: "e6c61887890399103d84e9848aa78dc6"
server_key_iv: "e30bff3959dcc9d5b65c25993978dc56"
server_key_version: "encryptionkey@0"
I20260810 06:40:22.033259 28321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "55c64594ace54314844affce3b44f92e"
format_stamp: "Formatted at 2026-08-10 06:40:22 on dist-test-slave-bw88"
server_key: "e6c61887890399103d84e9848aa78dc6"
server_key_iv: "e30bff3959dcc9d5b65c25993978dc56"
server_key_version: "encryptionkey@0"
I20260810 06:40:22.034643 28321 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:22.035432 28344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:22.035619 28321 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:22.035696 28321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "55c64594ace54314844affce3b44f92e"
format_stamp: "Formatted at 2026-08-10 06:40:22 on dist-test-slave-bw88"
server_key: "e6c61887890399103d84e9848aa78dc6"
server_key_iv: "e30bff3959dcc9d5b65c25993978dc56"
server_key_version: "encryptionkey@0"
I20260810 06:40:22.035781 28321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:22.050041 28321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:22.051904 28321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:22.052024 28321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:22.052242 28321 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:22.052525 28321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:22.052565 28321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:22.052588 28321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:22.052600 28321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:22.058794 28321 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:39525
I20260810 06:40:22.058845 28498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:39525 every 8 connection(s)
I20260810 06:40:22.059155 28321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
Aug 10 06:40:22 dist-test-slave-bw88 krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344022, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:22.067817 27937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:22.059825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:41209 (local address 127.27.41.190:36337)
0810 06:40:22.059889 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:22.059891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:22.060105 (+ 214us) server_negotiation.cc:407] Connection header received
0810 06:40:22.060624 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:22.060625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:22.060635 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:22.060687 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:22.061684 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:22.062184 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:22.063131 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:22.063317 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:22.063370 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:22.065432 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:22.065434 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:22.065434 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:22.065441 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:22.066649 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:22.067058 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:22.067059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:22.067059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:22.067111 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:22.067315 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:22.067316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:22.067316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:22.067413 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:22.067463 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:22.067684 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 06:40:22.067754 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 06:40:22.067981 28504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:22.059817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:36337 (local address 127.27.41.131:41209)
0810 06:40:22.059977 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:22.060019 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:22.060538 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:22.060747 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:22.060751 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:22.061324 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:22.061604 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:22.061609 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:22.062263 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:22.062264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:22.063056 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:22.063058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:22.063388 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:22.063389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:22.063493 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:22.063941 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:22.063948 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:22.065290 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:22.066765 (+ 1475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:22.066772 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:22.066773 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:22.066985 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:22.067168 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:22.067168 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:22.067169 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:22.067265 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:22.067463 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:22.067467 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:22.067577 (+ 110us) client_negotiation.cc:769] Sending connection context
0810 06:40:22.067657 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 06:40:22.067771 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260810 06:40:22.068354 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 28321
I20260810 06:40:22.068476 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:40:22.068616 28500 heartbeater.cc:347] Connected to a master server at 127.27.41.190:36337
I20260810 06:40:22.068688 27814 external_mini_cluster.cc:1428] Setting key ccec32ada329b33a17aec3aea08da7ec
I20260810 06:40:22.068712 28500 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:22.068904 28500 heartbeater.cc:511] Master 127.27.41.190:36337 requested a full tablet report, sending...
I20260810 06:40:22.069319 27882 ts_manager.cc:194] Registered new tserver with Master: 55c64594ace54314844affce3b44f92e (127.27.41.131:39525)
I20260810 06:40:22.069767 27882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:41209
I20260810 06:40:22.069931 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 06:40:22 dist-test-slave-bw88 krb5kdc[27822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344022, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 06:40:22 dist-test-slave-bw88 krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344022, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.41.129@KRBTEST.COM
I20260810 06:40:22.094913 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:22.087371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43686 (local address 127.27.41.129:45269)
0810 06:40:22.087549 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:22.087555 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:22.087583 (+ 28us) server_negotiation.cc:407] Connection header received
0810 06:40:22.087611 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:22.087612 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:22.087625 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:22.087700 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:22.088318 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:22.089082 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:22.089817 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:22.090160 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:22.090230 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:22.092371 (+ 2141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:22.092379 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:22.092379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:22.092386 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:22.093909 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:22.094212 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:22.094214 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:22.094214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:22.094270 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:22.094415 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:22.094416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:22.094416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:22.094553 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:22.094677 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:22.094709 (+ 32us) server_negotiation.cc:299] Negotiation successful
0810 06:40:22.094772 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":103,"threads_started":1}
W20260810 06:40:22.095265 28023 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43686
Aug 10 06:40:22 dist-test-slave-bw88 krb5kdc[27822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 06:40:22 dist-test-slave-bw88 krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.129@KRBTEST.COM
I20260810 06:40:22.117877 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:22.111231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43698 (local address 127.27.41.129:45269)
0810 06:40:22.111303 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:22.111305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:22.111331 (+ 26us) server_negotiation.cc:407] Connection header received
0810 06:40:22.111400 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:22.111401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:22.111410 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:22.111469 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:22.111999 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:22.112489 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:22.113177 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:22.113458 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:22.113511 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:22.115690 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:22.115691 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:22.115692 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:22.115698 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:22.116879 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:22.117180 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:22.117180 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:22.117181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:22.117232 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:22.117442 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:22.117443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:22.117443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:22.117552 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:22.117646 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:22.117716 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 06:40:22.117781 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 06:40:22.118409 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 27967
I20260810 06:40:22.130442 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 28141
I20260810 06:40:22.151974 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 28321
I20260810 06:40:22.161120 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 27841
2026-08-10T06:40:22Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2089 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:22 dist-test-slave-bw88 krb5kdc[28521](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:22 dist-test-slave-bw88 krb5kdc[28521](info): set up 2 sockets
Aug 10 06:40:22 dist-test-slave-bw88 krb5kdc[28521](info): commencing operation
krb5kdc: starting...
W20260810 06:40:23.437510 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:23 dist-test-slave-bw88 krb5kdc[28521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:40:23.561808 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:46835
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:46835
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:23.643895 28539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:23.644104 28539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:23.644126 28539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:23.645179 28539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:23.645213 28539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:23.645228 28539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:23.645241 28539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:23.645252 28539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:23.646663 28539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:46835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:46835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:23.646847 28539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:23.647024 28539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:23.651865 28549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:23.651865 28556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:23.651978 28551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:23.652359 28539 server_base.cc:1034] running on GCE node
I20260810 06:40:23.652587 28539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:23.652835 28539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:23.653995 28539 hybrid_clock.cc:648] HybridClock initialized: now 1786344023653984 us; error 30 us; skew 500 ppm
Aug 10 06:40:23 dist-test-slave-bw88 krb5kdc[28521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344023, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:23.656596 28539 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:40:23.657058 28539 webserver.cc:460] Webserver started at http://127.27.41.190:34843/ using document root <none> and password file <none>
I20260810 06:40:23.657274 28539 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:23.657375 28539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:23.657552 28539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:23.658614 28539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "60fb7844904a4a31a670532a79ab8690"
format_stamp: "Formatted at 2026-08-10 06:40:23 on dist-test-slave-bw88"
server_key: "110367737806dfe8128a25bc093dcc4c"
server_key_iv: "b4af34b87de8747d6eecb3a07baf21b8"
server_key_version: "encryptionkey@0"
I20260810 06:40:23.658973 28539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "60fb7844904a4a31a670532a79ab8690"
format_stamp: "Formatted at 2026-08-10 06:40:23 on dist-test-slave-bw88"
server_key: "110367737806dfe8128a25bc093dcc4c"
server_key_iv: "b4af34b87de8747d6eecb3a07baf21b8"
server_key_version: "encryptionkey@0"
I20260810 06:40:23.660336 28539 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:40:23.661043 28565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:23.661240 28539 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:23.661329 28539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "60fb7844904a4a31a670532a79ab8690"
format_stamp: "Formatted at 2026-08-10 06:40:23 on dist-test-slave-bw88"
server_key: "110367737806dfe8128a25bc093dcc4c"
server_key_iv: "b4af34b87de8747d6eecb3a07baf21b8"
server_key_version: "encryptionkey@0"
I20260810 06:40:23.661435 28539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:23.694794 28539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:23.697209 28539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:23.697326 28539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:23.701391 28539 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:46835
I20260810 06:40:23.701452 28632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:46835 every 8 connection(s)
I20260810 06:40:23.701808 28539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:23.702713 28633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:23.705039 28633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690: Bootstrap starting.
I20260810 06:40:23.705638 28633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:23.705902 28633 log.cc:824] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:23.706630 28633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690: No bootstrap required, opened a new log
I20260810 06:40:23.707188 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 28539
I20260810 06:40:23.707288 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:23.707461 27814 external_mini_cluster.cc:1428] Setting key 3b294d59522cf5c238a00f962317e666
I20260810 06:40:23.709412 28633 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60fb7844904a4a31a670532a79ab8690" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46835 } }
I20260810 06:40:23.709601 28633 raft_consensus.cc:374] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:23.709645 28633 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fb7844904a4a31a670532a79ab8690, State: Initialized, Role: FOLLOWER
I20260810 06:40:23.709774 28633 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60fb7844904a4a31a670532a79ab8690" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46835 } }
I20260810 06:40:23.709853 28633 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:23.709875 28633 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:23.709934 28633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:23.710543 28633 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60fb7844904a4a31a670532a79ab8690" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46835 } }
I20260810 06:40:23.710649 28633 leader_election.cc:302] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60fb7844904a4a31a670532a79ab8690; no voters:
I20260810 06:40:23.710836 28633 leader_election.cc:288] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:23.710913 28641 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:23.711084 28633 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:23.711095 28641 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [term 1 LEADER]: Becoming Leader. State: Replica: 60fb7844904a4a31a670532a79ab8690, State: Running, Role: LEADER
I20260810 06:40:23.711216 28641 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60fb7844904a4a31a670532a79ab8690" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46835 } }
I20260810 06:40:23.711570 28641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60fb7844904a4a31a670532a79ab8690. Latest consensus state: current_term: 1 leader_uuid: "60fb7844904a4a31a670532a79ab8690" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60fb7844904a4a31a670532a79ab8690" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46835 } } }
I20260810 06:40:23.711658 28641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:23.711836 28644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60fb7844904a4a31a670532a79ab8690" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60fb7844904a4a31a670532a79ab8690" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46835 } } }
I20260810 06:40:23.711916 28644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:23.712059 28654 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:23.712847 28654 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:23.714814 28654 catalog_manager.cc:1347] Generated new cluster ID: d57582197ef34cc28ab66205fc887288
I20260810 06:40:23.714879 28654 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:40:23 dist-test-slave-bw88 krb5kdc[28521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:23.722683 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:23.708067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52464 (local address 127.27.41.190:46835)
0810 06:40:23.708272 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:23.708282 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:23.708317 (+ 35us) server_negotiation.cc:407] Connection header received
0810 06:40:23.709339 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:23.709363 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:23.709428 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:23.709584 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:23.710374 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:23.711869 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:23.713073 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:23.713690 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:23.713797 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:23.719395 (+ 5598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:23.719399 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:23.719400 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:23.719413 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:23.721047 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:23.721446 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:23.721450 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:23.721450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:23.721543 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:23.721754 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:23.721754 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:23.721755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:23.721990 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:23.722177 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:23.722276 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 06:40:23.722513 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":95,"threads_started":1}
I20260810 06:40:23.726922 28654 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:23.727701 28654 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:23.732836 28654 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 60fb7844904a4a31a670532a79ab8690: Generated new TSK 0
I20260810 06:40:23.733021 28654 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:40:23.763882 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:46835
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:23.873553 28671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:23.873742 28671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:23.873765 28671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:23.874886 28671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:23.874926 28671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:23.874953 28671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:23.876461 28671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:46835
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:23.876685 28671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:23.876909 28671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:23.882088 28683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:23.882252 28671 server_base.cc:1034] running on GCE node
W20260810 06:40:23.882577 28680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:23.882706 28679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:23.882910 28671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:23.883116 28671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:23.884286 28671 hybrid_clock.cc:648] HybridClock initialized: now 1786344023884274 us; error 31 us; skew 500 ppm
Aug 10 06:40:23 dist-test-slave-bw88 krb5kdc[28521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344023, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:23.886883 28671 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:40:23.887336 28671 webserver.cc:460] Webserver started at http://127.27.41.129:40485/ using document root <none> and password file <none>
I20260810 06:40:23.887578 28671 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:23.887622 28671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:23.887780 28671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:23.888844 28671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "be5c68f5f88c463b81c52703bf13e87b"
format_stamp: "Formatted at 2026-08-10 06:40:23 on dist-test-slave-bw88"
server_key: "112d01b8d7652ca978e8bcbe5906d9d0"
server_key_iv: "22e4a641ecdaa0c0c7902a5e5bdfd026"
server_key_version: "encryptionkey@0"
I20260810 06:40:23.889212 28671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "be5c68f5f88c463b81c52703bf13e87b"
format_stamp: "Formatted at 2026-08-10 06:40:23 on dist-test-slave-bw88"
server_key: "112d01b8d7652ca978e8bcbe5906d9d0"
server_key_iv: "22e4a641ecdaa0c0c7902a5e5bdfd026"
server_key_version: "encryptionkey@0"
I20260810 06:40:23.890609 28671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:23.891368 28690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:23.891530 28671 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:23.891624 28671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "be5c68f5f88c463b81c52703bf13e87b"
format_stamp: "Formatted at 2026-08-10 06:40:23 on dist-test-slave-bw88"
server_key: "112d01b8d7652ca978e8bcbe5906d9d0"
server_key_iv: "22e4a641ecdaa0c0c7902a5e5bdfd026"
server_key_version: "encryptionkey@0"
I20260810 06:40:23.891697 28671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:23.903429 28671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:23.905768 28671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:23.905926 28671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:23.906173 28671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:23.906462 28671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:23.906494 28671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:23.906531 28671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:23.906559 28671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:23.912668 28671 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:36171
I20260810 06:40:23.912756 28845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:36171 every 8 connection(s)
I20260810 06:40:23.913054 28671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
Aug 10 06:40:23 dist-test-slave-bw88 krb5kdc[28521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344023, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:23.920311 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 28671
I20260810 06:40:23.920414 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:40:23.920584 27814 external_mini_cluster.cc:1428] Setting key 3b072b92fd4f068352c29694732cf3fa
I20260810 06:40:23.922375 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:23.913828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:35323 (local address 127.27.41.190:46835)
0810 06:40:23.913904 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:23.913906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:23.914082 (+ 176us) server_negotiation.cc:407] Connection header received
0810 06:40:23.915009 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:23.915011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:23.915020 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:23.915076 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:23.915661 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:23.916157 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:23.917135 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:23.917317 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:23.917446 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:23.919419 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:23.919421 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:23.919421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:23.919428 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:23.920910 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:23.921414 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:23.921416 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:23.921416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:23.921483 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:23.921736 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:23.921737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:23.921737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:23.921859 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:23.921930 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:23.922197 (+ 267us) server_negotiation.cc:299] Negotiation successful
0810 06:40:23.922287 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 06:40:23.922580 28850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:23.913786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46835 (local address 127.27.41.129:35323)
0810 06:40:23.913963 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:23.913999 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:23.914919 (+ 920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:23.915130 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:23.915133 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:23.915382 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:23.915572 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:23.915576 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:23.916234 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:23.916235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:23.917063 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:23.917065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:23.917455 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:23.917456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:23.917576 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:23.917989 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:23.917997 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:23.919329 (+ 1332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:23.920983 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:23.920990 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:23.920991 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:23.921297 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:23.921559 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:23.921560 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:23.921561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:23.921670 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:23.921930 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:23.921939 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:23.922071 (+ 132us) client_negotiation.cc:769] Sending connection context
0810 06:40:23.922175 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 06:40:23.922328 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":95,"threads_started":1}
I20260810 06:40:23.923115 28848 heartbeater.cc:347] Connected to a master server at 127.27.41.190:46835
I20260810 06:40:23.923220 28848 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:23.923414 28848 heartbeater.cc:511] Master 127.27.41.190:46835 requested a full tablet report, sending...
I20260810 06:40:23.923978 28584 ts_manager.cc:194] Registered new tserver with Master: be5c68f5f88c463b81c52703bf13e87b (127.27.41.129:36171)
I20260810 06:40:23.924844 28584 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:35323
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:40:23.945726 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:46835
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:24.030055 28856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:24.030260 28856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:24.030285 28856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:24.031347 28856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:24.031383 28856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:24.031409 28856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:24.032863 28856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:46835
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:24.033061 28856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:24.033227 28856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:24.038170 28862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:24.038174 28866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:24.038374 28856 server_base.cc:1034] running on GCE node
W20260810 06:40:24.038189 28863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:24.038659 28856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:24.038915 28856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:24.040084 28856 hybrid_clock.cc:648] HybridClock initialized: now 1786344024040074 us; error 45 us; skew 500 ppm
Aug 10 06:40:24 dist-test-slave-bw88 krb5kdc[28521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344024, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:24.042580 28856 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:40:24.043032 28856 webserver.cc:460] Webserver started at http://127.27.41.130:45497/ using document root <none> and password file <none>
I20260810 06:40:24.043263 28856 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:24.043344 28856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:24.043500 28856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:24.044528 28856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "9614cdcf586d4bc1b87a16d081644cb4"
format_stamp: "Formatted at 2026-08-10 06:40:24 on dist-test-slave-bw88"
server_key: "d64f1c6f008b2f80eb7a89ea8244e6d3"
server_key_iv: "a8e6470c24036e18eb4ef27a53f25961"
server_key_version: "encryptionkey@0"
I20260810 06:40:24.044898 28856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "9614cdcf586d4bc1b87a16d081644cb4"
format_stamp: "Formatted at 2026-08-10 06:40:24 on dist-test-slave-bw88"
server_key: "d64f1c6f008b2f80eb7a89ea8244e6d3"
server_key_iv: "a8e6470c24036e18eb4ef27a53f25961"
server_key_version: "encryptionkey@0"
I20260810 06:40:24.046370 28856 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:40:24.047122 28875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:24.047320 28856 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:24.047459 28856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "9614cdcf586d4bc1b87a16d081644cb4"
format_stamp: "Formatted at 2026-08-10 06:40:24 on dist-test-slave-bw88"
server_key: "d64f1c6f008b2f80eb7a89ea8244e6d3"
server_key_iv: "a8e6470c24036e18eb4ef27a53f25961"
server_key_version: "encryptionkey@0"
I20260810 06:40:24.047538 28856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:24.063074 28856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:24.065099 28856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:24.065272 28856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:24.065534 28856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:24.065838 28856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:24.065891 28856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:24.065930 28856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:24.065979 28856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:24.071990 28856 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:44371
I20260810 06:40:24.072054 29032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:44371 every 8 connection(s)
I20260810 06:40:24.072347 28856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
Aug 10 06:40:24 dist-test-slave-bw88 krb5kdc[28521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344024, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:24.080796 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 28856
I20260810 06:40:24.080922 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:40:24.081103 27814 external_mini_cluster.cc:1428] Setting key fc6536452aa105aac150a3c0a86eccf9
I20260810 06:40:24.081413 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.073070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:48449 (local address 127.27.41.190:46835)
0810 06:40:24.073135 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:24.073137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:24.073349 (+ 212us) server_negotiation.cc:407] Connection header received
0810 06:40:24.074343 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:24.074345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:24.074355 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:24.074411 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:24.074971 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.075466 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.076393 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.076580 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.076628 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.078711 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:24.078712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:24.078713 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:24.078720 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:24.079969 (+ 1249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:24.080358 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:24.080359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:24.080360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:24.080420 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:24.080679 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:24.080680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:24.080680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:24.080792 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:24.080856 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:24.081198 (+ 342us) server_negotiation.cc:299] Negotiation successful
0810 06:40:24.081290 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 06:40:24.081574 29035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.073056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46835 (local address 127.27.41.130:48449)
0810 06:40:24.073214 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:24.073255 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:24.074252 (+ 997us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:24.074473 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:24.074476 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:24.074712 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:24.074905 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.074909 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.075549 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.075550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.076325 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.076327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.076648 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.076649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.076744 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.077170 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:24.077177 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:24.078615 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:24.080054 (+ 1439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:24.080062 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:24.080064 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:24.080281 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:24.080483 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:24.080484 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:24.080484 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:24.080593 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:24.080861 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:24.080868 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:24.081049 (+ 181us) client_negotiation.cc:769] Sending connection context
0810 06:40:24.081173 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 06:40:24.081325 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
I20260810 06:40:24.082053 29033 heartbeater.cc:347] Connected to a master server at 127.27.41.190:46835
I20260810 06:40:24.082155 29033 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:24.082336 29033 heartbeater.cc:511] Master 127.27.41.190:46835 requested a full tablet report, sending...
I20260810 06:40:24.082680 28584 ts_manager.cc:194] Registered new tserver with Master: 9614cdcf586d4bc1b87a16d081644cb4 (127.27.41.130:44371)
I20260810 06:40:24.083074 28584 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:48449
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:40:24.106019 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:46835
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:24.190274 29038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:24.190554 29038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:24.190579 29038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:24.191696 29038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:24.191733 29038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:24.191758 29038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:24.193288 29038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:46835
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:24.193527 29038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:24.193724 29038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:24.198863 29048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:24.198895 29046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:24.199018 29038 server_base.cc:1034] running on GCE node
W20260810 06:40:24.198895 29044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:24.199467 29038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:24.199904 29038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:24.201092 29038 hybrid_clock.cc:648] HybridClock initialized: now 1786344024201070 us; error 38 us; skew 500 ppm
Aug 10 06:40:24 dist-test-slave-bw88 krb5kdc[28521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344024, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:24.203990 29038 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:40:24.204466 29038 webserver.cc:460] Webserver started at http://127.27.41.131:45721/ using document root <none> and password file <none>
I20260810 06:40:24.204730 29038 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:24.204797 29038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:24.204949 29038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:24.206066 29038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "e9561631c6b9423fa39c986edd19307c"
format_stamp: "Formatted at 2026-08-10 06:40:24 on dist-test-slave-bw88"
server_key: "6ec36e1feb0883f05e4289e9e9ac3be7"
server_key_iv: "8ed2ddf0792bb9af00066d89d5316254"
server_key_version: "encryptionkey@0"
I20260810 06:40:24.206452 29038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "e9561631c6b9423fa39c986edd19307c"
format_stamp: "Formatted at 2026-08-10 06:40:24 on dist-test-slave-bw88"
server_key: "6ec36e1feb0883f05e4289e9e9ac3be7"
server_key_iv: "8ed2ddf0792bb9af00066d89d5316254"
server_key_version: "encryptionkey@0"
I20260810 06:40:24.207964 29038 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:40:24.208825 29059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:24.209007 29038 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:24.209115 29038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "e9561631c6b9423fa39c986edd19307c"
format_stamp: "Formatted at 2026-08-10 06:40:24 on dist-test-slave-bw88"
server_key: "6ec36e1feb0883f05e4289e9e9ac3be7"
server_key_iv: "8ed2ddf0792bb9af00066d89d5316254"
server_key_version: "encryptionkey@0"
I20260810 06:40:24.209187 29038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:24.226963 29038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:24.229439 29038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:24.229609 29038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:24.229858 29038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:24.230173 29038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:24.230224 29038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:24.230260 29038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:24.230288 29038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:24.236402 29038 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:46545
I20260810 06:40:24.236450 29212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:46545 every 8 connection(s)
I20260810 06:40:24.236763 29038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:40:24.241068 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 29038
I20260810 06:40:24.241150 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:40:24.241317 27814 external_mini_cluster.cc:1428] Setting key 44e94435c122a9da7468a3c3c38611cd
Aug 10 06:40:24 dist-test-slave-bw88 krb5kdc[28521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344024, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:24.246125 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.237456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:51105 (local address 127.27.41.190:46835)
0810 06:40:24.237498 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:24.237500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:24.237716 (+ 216us) server_negotiation.cc:407] Connection header received
0810 06:40:24.238670 (+ 954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:24.238672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:24.238685 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:24.238740 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:24.239366 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.239883 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.240869 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.241092 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.241177 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.243603 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:24.243604 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:24.243605 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:24.243613 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:24.244731 (+ 1118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:24.245148 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:24.245149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:24.245149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:24.245207 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:24.245498 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:24.245499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:24.245500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:24.245614 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:24.245685 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:24.245949 (+ 264us) server_negotiation.cc:299] Negotiation successful
0810 06:40:24.246041 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 06:40:24.246289 29217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.237468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46835 (local address 127.27.41.131:51105)
0810 06:40:24.237599 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:24.237634 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:24.238557 (+ 923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:24.238812 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:24.238816 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:24.239080 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:24.239268 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.239273 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.239975 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.239977 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.240776 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.240778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.241223 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.241224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.241368 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.241971 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:24.241982 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:24.243510 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:24.244820 (+ 1310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:24.244828 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:24.244830 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:24.245064 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:24.245274 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:24.245275 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:24.245275 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:24.245430 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:24.245677 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:24.245685 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:24.245821 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 06:40:24.245915 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 06:40:24.246067 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":64,"threads_started":1}
I20260810 06:40:24.246762 29214 heartbeater.cc:347] Connected to a master server at 127.27.41.190:46835
I20260810 06:40:24.246860 29214 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:24.247035 29214 heartbeater.cc:511] Master 127.27.41.190:46835 requested a full tablet report, sending...
I20260810 06:40:24.247408 28584 ts_manager.cc:194] Registered new tserver with Master: e9561631c6b9423fa39c986edd19307c (127.27.41.131:46545)
I20260810 06:40:24.247785 28584 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:51105
I20260810 06:40:24.253047 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:40:24.260069 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.254583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52472 (local address 127.27.41.190:46835)
0810 06:40:24.254642 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:24.254644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:24.254703 (+ 59us) server_negotiation.cc:407] Connection header received
0810 06:40:24.254751 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:24.254751 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:24.254759 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:24.254804 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:24.255313 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.255820 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.256471 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.256644 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.256691 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.257795 (+ 1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:24.257796 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:24.257797 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:24.257818 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:24.258944 (+ 1126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:24.259260 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:24.259261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:24.259261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:24.259308 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:24.259464 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:24.259464 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:24.259465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:24.259591 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:24.259667 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:24.259854 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 06:40:24.259978 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 06:40:24.262293 28584 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52472:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:40:24.263872 28584 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:24.270346 29232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.266305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44230 (local address 127.27.41.131:46545)
0810 06:40:24.266854 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:24.266859 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:24.266868 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:24.266909 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:24.266911 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:24.266923 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:24.267008 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:24.267273 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.267924 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.269315 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.269922 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.270017 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.270091 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:24.270229 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 06:40:24.270272 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":95,"threads_started":1}
I20260810 06:40:24.270339 29234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.266227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:46545 (local address 127.0.0.1:44230)
0810 06:40:24.266577 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:24.266588 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:24.266648 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:24.267010 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:24.267011 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:24.267013 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:24.267096 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.267099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.268027 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.268036 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.269220 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.269223 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.270021 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.270022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.270121 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.270135 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 06:40:24.270205 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 06:40:24.270263 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":1,"thread_start_us":60,"threads_started":1}
I20260810 06:40:24.270910 29231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.266437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:44371 (local address 127.0.0.1:38252)
0810 06:40:24.266674 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:24.266684 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:24.266733 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:24.267125 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:24.267126 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:24.267128 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:24.267168 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.267169 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.268420 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.268421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.269499 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.269502 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.270694 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.270695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.270753 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.270758 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:40:24.270805 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 06:40:24.270845 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":74,"threads_started":1}
I20260810 06:40:24.271279 29236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.266678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38252 (local address 127.27.41.130:44371)
0810 06:40:24.266873 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:24.266878 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:24.266888 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:40:24.266929 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:24.266940 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:24.266956 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:24.267032 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:24.267247 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.268309 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.269596 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.270307 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.270378 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.271118 (+ 740us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:24.271145 (+ 27us) server_negotiation.cc:299] Negotiation successful
0810 06:40:24.271194 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":94,"threads_started":1}
I20260810 06:40:24.271245 29122 tablet_service.cc:1467] Processing CreateTablet for tablet 3c773e6c045047909a2c02a3f884abff (DEFAULT_TABLE table=test-table [id=b4fa6593ae804262a691ac5a0d3f0ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:24.271642 29122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c773e6c045047909a2c02a3f884abff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:24.271783 29228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.266227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:36171 (local address 127.0.0.1:36918)
0810 06:40:24.266390 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:24.266425 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:24.266490 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:24.266961 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:24.266964 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:24.266966 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:24.267114 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.267117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.269388 (+ 2271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.269389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.270471 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.270475 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.271507 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.271508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.271570 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.271574 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:24.271636 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 06:40:24.271675 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":71,"threads_started":1}
I20260810 06:40:24.271828 29235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.266425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36918 (local address 127.27.41.129:36171)
0810 06:40:24.266675 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:24.266680 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:24.266691 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:40:24.266745 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:24.266747 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:24.266761 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:24.266861 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:24.267207 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.268309 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.270573 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.271247 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.271326 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.271389 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:24.271654 (+ 265us) server_negotiation.cc:299] Negotiation successful
0810 06:40:24.271693 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":126,"threads_started":1}
I20260810 06:40:24.272194 28946 tablet_service.cc:1467] Processing CreateTablet for tablet 3c773e6c045047909a2c02a3f884abff (DEFAULT_TABLE table=test-table [id=b4fa6593ae804262a691ac5a0d3f0ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:24.272526 28946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c773e6c045047909a2c02a3f884abff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:24.272519 28763 tablet_service.cc:1467] Processing CreateTablet for tablet 3c773e6c045047909a2c02a3f884abff (DEFAULT_TABLE table=test-table [id=b4fa6593ae804262a691ac5a0d3f0ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:24.272843 28763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c773e6c045047909a2c02a3f884abff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:24.275295 29237 tablet_bootstrap.cc:492] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c: Bootstrap starting.
I20260810 06:40:24.275590 29238 tablet_bootstrap.cc:492] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b: Bootstrap starting.
I20260810 06:40:24.276014 29239 tablet_bootstrap.cc:492] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4: Bootstrap starting.
I20260810 06:40:24.276211 29237 tablet_bootstrap.cc:654] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:24.276336 29238 tablet_bootstrap.cc:654] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:24.276733 29239 tablet_bootstrap.cc:654] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:24.276885 29238 log.cc:824] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:24.276924 29237 log.cc:824] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:24.277391 29239 log.cc:824] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:24.277817 29237 tablet_bootstrap.cc:492] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c: No bootstrap required, opened a new log
I20260810 06:40:24.277819 29238 tablet_bootstrap.cc:492] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b: No bootstrap required, opened a new log
I20260810 06:40:24.277917 29237 ts_tablet_manager.cc:1397] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:40:24.277918 29238 ts_tablet_manager.cc:1397] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:40:24.278187 29239 tablet_bootstrap.cc:492] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4: No bootstrap required, opened a new log
I20260810 06:40:24.278257 29239 ts_tablet_manager.cc:1397] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:40:24.279475 29237 raft_consensus.cc:348] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5c68f5f88c463b81c52703bf13e87b" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36171 } } peers { permanent_uuid: "9614cdcf586d4bc1b87a16d081644cb4" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44371 } } peers { permanent_uuid: "e9561631c6b9423fa39c986edd19307c" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46545 } }
I20260810 06:40:24.279685 29237 raft_consensus.cc:374] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:24.279742 29237 raft_consensus.cc:729] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9561631c6b9423fa39c986edd19307c, State: Initialized, Role: FOLLOWER
I20260810 06:40:24.279861 29237 consensus_queue.cc:260] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5c68f5f88c463b81c52703bf13e87b" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36171 } } peers { permanent_uuid: "9614cdcf586d4bc1b87a16d081644cb4" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44371 } } peers { permanent_uuid: "e9561631c6b9423fa39c986edd19307c" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46545 } }
I20260810 06:40:24.279991 29238 raft_consensus.cc:348] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5c68f5f88c463b81c52703bf13e87b" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36171 } } peers { permanent_uuid: "9614cdcf586d4bc1b87a16d081644cb4" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44371 } } peers { permanent_uuid: "e9561631c6b9423fa39c986edd19307c" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46545 } }
I20260810 06:40:24.280149 29237 ts_tablet_manager.cc:1428] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 06:40:24.280200 29238 raft_consensus.cc:374] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:24.280234 29238 raft_consensus.cc:729] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5c68f5f88c463b81c52703bf13e87b, State: Initialized, Role: FOLLOWER
I20260810 06:40:24.280191 29214 heartbeater.cc:503] Master 127.27.41.190:46835 was elected leader, sending a full tablet report...
I20260810 06:40:24.280365 29238 consensus_queue.cc:260] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5c68f5f88c463b81c52703bf13e87b" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36171 } } peers { permanent_uuid: "9614cdcf586d4bc1b87a16d081644cb4" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44371 } } peers { permanent_uuid: "e9561631c6b9423fa39c986edd19307c" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46545 } }
I20260810 06:40:24.280397 29239 raft_consensus.cc:348] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5c68f5f88c463b81c52703bf13e87b" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36171 } } peers { permanent_uuid: "9614cdcf586d4bc1b87a16d081644cb4" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44371 } } peers { permanent_uuid: "e9561631c6b9423fa39c986edd19307c" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46545 } }
I20260810 06:40:24.280580 29239 raft_consensus.cc:374] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:24.280618 29239 raft_consensus.cc:729] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9614cdcf586d4bc1b87a16d081644cb4, State: Initialized, Role: FOLLOWER
I20260810 06:40:24.280670 29238 ts_tablet_manager.cc:1428] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:40:24.280786 28848 heartbeater.cc:503] Master 127.27.41.190:46835 was elected leader, sending a full tablet report...
I20260810 06:40:24.280773 29239 consensus_queue.cc:260] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5c68f5f88c463b81c52703bf13e87b" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36171 } } peers { permanent_uuid: "9614cdcf586d4bc1b87a16d081644cb4" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44371 } } peers { permanent_uuid: "e9561631c6b9423fa39c986edd19307c" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46545 } }
I20260810 06:40:24.281067 29239 ts_tablet_manager.cc:1428] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:40:24.281117 29033 heartbeater.cc:503] Master 127.27.41.190:46835 was elected leader, sending a full tablet report...
W20260810 06:40:24.322933 29034 tablet.cc:2369] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:40:24.336822 29243 raft_consensus.cc:482] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:24.336947 29243 raft_consensus.cc:504] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5c68f5f88c463b81c52703bf13e87b" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36171 } } peers { permanent_uuid: "9614cdcf586d4bc1b87a16d081644cb4" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44371 } } peers { permanent_uuid: "e9561631c6b9423fa39c986edd19307c" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46545 } }
I20260810 06:40:24.337424 29243 leader_election.cc:288] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5c68f5f88c463b81c52703bf13e87b (127.27.41.129:36171), 9614cdcf586d4bc1b87a16d081644cb4 (127.27.41.130:44371)
I20260810 06:40:24.341722 29235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.337721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:47929 (local address 127.27.41.129:36171)
0810 06:40:24.337763 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:24.337765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:24.337776 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:40:24.337848 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:24.337850 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:24.337860 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:24.337927 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:24.338183 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.339044 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.340646 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.341294 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.341433 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.341446 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:24.341601 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 06:40:24.341645 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 06:40:24.341722 29236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.337875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:55317 (local address 127.27.41.130:44371)
0810 06:40:24.337930 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:24.337932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:24.338067 (+ 135us) server_negotiation.cc:407] Connection header received
0810 06:40:24.338149 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:24.338150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:24.338162 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:24.338229 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:24.338322 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.339113 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.340671 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.341295 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.341455 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.341466 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:24.341614 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 06:40:24.341659 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 06:40:24.341727 29217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.337644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:36171 (local address 127.27.41.131:47929)
0810 06:40:24.337702 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:24.337717 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:24.337771 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:24.337991 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:24.337993 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:24.337995 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:24.338096 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.338099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.339138 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.339139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.340523 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.340526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.341424 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.341425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.341513 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.341518 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:40:24.341578 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 06:40:24.341628 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":78}
I20260810 06:40:24.341737 29246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.337806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:44371 (local address 127.27.41.131:55317)
0810 06:40:24.338006 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:24.338016 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:24.338073 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:24.338236 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:24.338236 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:24.338237 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:24.338282 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.338283 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.339185 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.339186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.340523 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:24.340526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.341455 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.341456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:24.341524 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.341527 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:24.341597 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 06:40:24.341630 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":6,"thread_start_us":141,"threads_started":1}
I20260810 06:40:24.342114 28973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c773e6c045047909a2c02a3f884abff" candidate_uuid: "e9561631c6b9423fa39c986edd19307c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9614cdcf586d4bc1b87a16d081644cb4" is_pre_election: true
I20260810 06:40:24.342272 28973 raft_consensus.cc:2454] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9561631c6b9423fa39c986edd19307c in term 0.
I20260810 06:40:24.342243 28787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c773e6c045047909a2c02a3f884abff" candidate_uuid: "e9561631c6b9423fa39c986edd19307c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5c68f5f88c463b81c52703bf13e87b" is_pre_election: true
I20260810 06:40:24.342442 28787 raft_consensus.cc:2454] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9561631c6b9423fa39c986edd19307c in term 0.
I20260810 06:40:24.342520 29060 leader_election.cc:302] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9614cdcf586d4bc1b87a16d081644cb4, e9561631c6b9423fa39c986edd19307c; no voters:
I20260810 06:40:24.342664 29243 raft_consensus.cc:2781] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:24.342736 29243 raft_consensus.cc:482] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:24.342753 29243 raft_consensus.cc:3037] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:24.343536 29243 raft_consensus.cc:504] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5c68f5f88c463b81c52703bf13e87b" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36171 } } peers { permanent_uuid: "9614cdcf586d4bc1b87a16d081644cb4" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44371 } } peers { permanent_uuid: "e9561631c6b9423fa39c986edd19307c" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46545 } }
I20260810 06:40:24.343647 29243 leader_election.cc:288] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [CANDIDATE]: Term 1 election: Requested vote from peers be5c68f5f88c463b81c52703bf13e87b (127.27.41.129:36171), 9614cdcf586d4bc1b87a16d081644cb4 (127.27.41.130:44371)
I20260810 06:40:24.343851 28787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c773e6c045047909a2c02a3f884abff" candidate_uuid: "e9561631c6b9423fa39c986edd19307c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5c68f5f88c463b81c52703bf13e87b"
I20260810 06:40:24.343896 28973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c773e6c045047909a2c02a3f884abff" candidate_uuid: "e9561631c6b9423fa39c986edd19307c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9614cdcf586d4bc1b87a16d081644cb4"
I20260810 06:40:24.343933 28787 raft_consensus.cc:3037] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:24.344014 28973 raft_consensus.cc:3037] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:24.344722 28787 raft_consensus.cc:2454] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9561631c6b9423fa39c986edd19307c in term 1.
I20260810 06:40:24.344827 28973 raft_consensus.cc:2454] T 3c773e6c045047909a2c02a3f884abff P 9614cdcf586d4bc1b87a16d081644cb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9561631c6b9423fa39c986edd19307c in term 1.
I20260810 06:40:24.344893 29060 leader_election.cc:302] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be5c68f5f88c463b81c52703bf13e87b, e9561631c6b9423fa39c986edd19307c; no voters:
I20260810 06:40:24.345011 29243 raft_consensus.cc:2781] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:24.345175 29243 raft_consensus.cc:686] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [term 1 LEADER]: Becoming Leader. State: Replica: e9561631c6b9423fa39c986edd19307c, State: Running, Role: LEADER
I20260810 06:40:24.345293 29243 consensus_queue.cc:237] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5c68f5f88c463b81c52703bf13e87b" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36171 } } peers { permanent_uuid: "9614cdcf586d4bc1b87a16d081644cb4" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44371 } } peers { permanent_uuid: "e9561631c6b9423fa39c986edd19307c" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46545 } }
I20260810 06:40:24.346163 28584 catalog_manager.cc:5495] T 3c773e6c045047909a2c02a3f884abff P e9561631c6b9423fa39c986edd19307c reported cstate change: term changed from 0 to 1, leader changed from <none> to e9561631c6b9423fa39c986edd19307c (127.27.41.131). New cstate: current_term: 1 leader_uuid: "e9561631c6b9423fa39c986edd19307c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5c68f5f88c463b81c52703bf13e87b" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9614cdcf586d4bc1b87a16d081644cb4" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9561631c6b9423fa39c986edd19307c" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46545 } health_report { overall_health: HEALTHY } } }
Aug 10 06:40:24 dist-test-slave-bw88 krb5kdc[28521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.129@KRBTEST.COM
I20260810 06:40:24.368228 29235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.360550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36930 (local address 127.27.41.129:36171)
0810 06:40:24.360643 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:24.360645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:24.360695 (+ 50us) server_negotiation.cc:407] Connection header received
0810 06:40:24.360741 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:24.360742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:24.360752 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:24.360807 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:24.361465 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.361947 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.362654 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.362833 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.362896 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.365262 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:24.365274 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:24.365274 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:24.365281 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:24.367146 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:24.367479 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:24.367482 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:24.367482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:24.367545 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:24.367717 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:24.367718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:24.367718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:24.367871 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:24.368001 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:24.368039 (+ 38us) server_negotiation.cc:299] Negotiation successful
0810 06:40:24.368106 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Aug 10 06:40:24 dist-test-slave-bw88 krb5kdc[28521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344024, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 06:40:24 dist-test-slave-bw88 krb5kdc[28521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344024, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.41.129@KRBTEST.COM
I20260810 06:40:24.392076 29235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.385368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36946 (local address 127.27.41.129:36171)
0810 06:40:24.385421 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:24.385423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:24.385516 (+ 93us) server_negotiation.cc:407] Connection header received
0810 06:40:24.385608 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:24.385609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:24.385624 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:24.385680 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:24.386231 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.386690 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.387409 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.387601 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.387669 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.389898 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:24.389899 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:24.389900 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:24.389906 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:24.391125 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:24.391460 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:24.391461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:24.391461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:24.391505 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:24.391668 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:24.391669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:24.391669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:24.391748 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:24.391815 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:24.391960 (+ 145us) server_negotiation.cc:299] Negotiation successful
0810 06:40:24.392014 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
Aug 10 06:40:24 dist-test-slave-bw88 krb5kdc[28521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 06:40:24 dist-test-slave-bw88 krb5kdc[28521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.129@KRBTEST.COM
W20260810 06:40:24.413842 28849 tablet.cc:2369] T 3c773e6c045047909a2c02a3f884abff P be5c68f5f88c463b81c52703bf13e87b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:40:24.414614 29235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:24.407646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36950 (local address 127.27.41.129:36171)
0810 06:40:24.407709 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:24.407711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:24.407740 (+ 29us) server_negotiation.cc:407] Connection header received
0810 06:40:24.407838 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:24.407839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:24.407854 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:24.407913 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:24.408446 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.408940 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.409711 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:24.409897 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:24.409966 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:24.412193 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:24.412194 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:24.412195 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:24.412201 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:24.413629 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:24.413955 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:24.413956 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:24.413956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:24.414015 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:24.414192 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:24.414193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:24.414193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:24.414285 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:24.414370 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:24.414456 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 06:40:24.414512 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 06:40:24.415081 28732 tablet_service.cc:2908] Rejecting scan request for tablet 3c773e6c045047909a2c02a3f884abff: Uninitialized: clean time has not yet been initialized
I20260810 06:40:24.415832 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 28671
I20260810 06:40:24.428376 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 28856
I20260810 06:40:24.436347 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 29038
I20260810 06:40:24.446516 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 28539
2026-08-10T06:40:24Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2286 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:24 dist-test-slave-bw88 krb5kdc[29265](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:24 dist-test-slave-bw88 krb5kdc[29265](info): set up 2 sockets
Aug 10 06:40:24 dist-test-slave-bw88 krb5kdc[29265](info): commencing operation
krb5kdc: starting...
W20260810 06:40:25.647105 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:25 dist-test-slave-bw88 krb5kdc[29265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:40:25.768471 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:45291
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:41493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:45291
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:25.850556 29289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:25.850798 29289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:25.850834 29289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:25.851944 29289 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:25.852005 29289 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 06:40:25.852025 29289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:25.852047 29289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:25.852075 29289 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:25.852104 29289 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:25.853585 29289 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:41493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:45291
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:45291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:25.853870 29289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:25.854097 29289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:25.859105 29296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:25.859066 29295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:25.859319 29289 server_base.cc:1034] running on GCE node
W20260810 06:40:25.859071 29298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:25.859678 29289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:25.859927 29289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:25.861065 29289 hybrid_clock.cc:648] HybridClock initialized: now 1786344025861053 us; error 30 us; skew 500 ppm
Aug 10 06:40:25 dist-test-slave-bw88 krb5kdc[29265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344025, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:25.863529 29289 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:40:25.863946 29289 webserver.cc:460] Webserver started at http://127.27.41.190:39255/ using document root <none> and password file <none>
I20260810 06:40:25.864159 29289 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:25.864202 29289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:25.864291 29289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:25.865303 29289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "b8720616b9f1492f969ace8dddc1c24d"
format_stamp: "Formatted at 2026-08-10 06:40:25 on dist-test-slave-bw88"
server_key: "8042c2280738e68d66f63b67deb95c7e"
server_key_iv: "716da1016ddbcec700addb387358204f"
server_key_version: "encryptionkey@0"
I20260810 06:40:25.865670 29289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "b8720616b9f1492f969ace8dddc1c24d"
format_stamp: "Formatted at 2026-08-10 06:40:25 on dist-test-slave-bw88"
server_key: "8042c2280738e68d66f63b67deb95c7e"
server_key_iv: "716da1016ddbcec700addb387358204f"
server_key_version: "encryptionkey@0"
I20260810 06:40:25.866932 29289 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:25.867645 29309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:25.867871 29289 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:25.867981 29289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "b8720616b9f1492f969ace8dddc1c24d"
format_stamp: "Formatted at 2026-08-10 06:40:25 on dist-test-slave-bw88"
server_key: "8042c2280738e68d66f63b67deb95c7e"
server_key_iv: "716da1016ddbcec700addb387358204f"
server_key_version: "encryptionkey@0"
I20260810 06:40:25.868041 29289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:25.884426 29289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:25.886912 29289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:25.887037 29289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:25.892239 29289 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:45291
I20260810 06:40:25.892333 29391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:45291 every 8 connection(s)
I20260810 06:40:25.892683 29289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:25.893461 29392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:25.893626 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 29289
I20260810 06:40:25.893718 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:25.893929 27814 external_mini_cluster.cc:1428] Setting key aa68e8022d12cca74cdc114df4937654
I20260810 06:40:25.896992 29392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d: Bootstrap starting.
I20260810 06:40:25.897737 29392 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:25.898017 29392 log.cc:824] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:25.898840 29392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d: No bootstrap required, opened a new log
Aug 10 06:40:25 dist-test-slave-bw88 krb5kdc[29265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:25.901309 29392 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8720616b9f1492f969ace8dddc1c24d" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45291 } }
I20260810 06:40:25.901531 29392 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:25.901579 29392 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8720616b9f1492f969ace8dddc1c24d, State: Initialized, Role: FOLLOWER
I20260810 06:40:25.901719 29392 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8720616b9f1492f969ace8dddc1c24d" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45291 } }
I20260810 06:40:25.901820 29392 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:25.901885 29392 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:25.901937 29392 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:25.902470 29392 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8720616b9f1492f969ace8dddc1c24d" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45291 } }
I20260810 06:40:25.902598 29392 leader_election.cc:302] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8720616b9f1492f969ace8dddc1c24d; no voters:
I20260810 06:40:25.902781 29392 leader_election.cc:288] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:25.902812 29398 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:25.902930 29398 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [term 1 LEADER]: Becoming Leader. State: Replica: b8720616b9f1492f969ace8dddc1c24d, State: Running, Role: LEADER
I20260810 06:40:25.903067 29392 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:25.903052 29398 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8720616b9f1492f969ace8dddc1c24d" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45291 } }
I20260810 06:40:25.903690 29400 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8720616b9f1492f969ace8dddc1c24d. Latest consensus state: current_term: 1 leader_uuid: "b8720616b9f1492f969ace8dddc1c24d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8720616b9f1492f969ace8dddc1c24d" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45291 } } }
I20260810 06:40:25.903698 29399 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8720616b9f1492f969ace8dddc1c24d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8720616b9f1492f969ace8dddc1c24d" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45291 } } }
I20260810 06:40:25.903797 29400 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:25.903821 29399 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:25.904567 29412 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:25.905282 29412 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:25.905517 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:25.894472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55246 (local address 127.27.41.190:45291)
0810 06:40:25.894687 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:25.894696 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:25.894727 (+ 31us) server_negotiation.cc:407] Connection header received
0810 06:40:25.895200 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:25.895209 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:25.895274 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:25.895425 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:25.896025 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:25.897454 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:25.898237 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:25.898752 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:25.898838 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:25.901528 (+ 2690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:25.901533 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:25.901533 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:25.901545 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:25.903639 (+ 2094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:25.904071 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:25.904073 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:25.904074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:25.904175 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:25.904417 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:25.904417 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:25.904418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:25.904751 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:25.904898 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:25.905060 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 06:40:25.905203 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":167,"thread_start_us":74,"threads_started":1}
I20260810 06:40:25.907070 29412 catalog_manager.cc:1347] Generated new cluster ID: 94f68d963f2540eb8906b8ed20bae1f8
I20260810 06:40:25.907127 29412 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:25.915316 29412 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:25.915825 29412 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:25.918820 29412 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d: Generated new TSK 0
I20260810 06:40:25.918998 29412 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:40:25.949617 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:45291
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:41493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:26.032227 29427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:26.032464 29427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:26.032507 29427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:26.033732 29427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:26.033789 29427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:26.033825 29427 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:40:26.033875 29427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:26.035370 29427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:41493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.41.190:45291
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:26.035640 29427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:26.035876 29427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:26.041002 29437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:26.041118 29427 server_base.cc:1034] running on GCE node
W20260810 06:40:26.041049 29434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:26.041277 29432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:26.041502 29427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:26.041776 29427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:26.042932 29427 hybrid_clock.cc:648] HybridClock initialized: now 1786344026042916 us; error 44 us; skew 500 ppm
Aug 10 06:40:26 dist-test-slave-bw88 krb5kdc[29265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344026, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:26.045398 29427 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:40:26.045773 29427 webserver.cc:460] Webserver started at http://127.27.41.129:42049/ using document root <none> and password file <none>
I20260810 06:40:26.045957 29427 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:26.046000 29427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:26.046094 29427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:26.047134 29427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "4fc516aaed074d3a9c19f8c7678f2a61"
format_stamp: "Formatted at 2026-08-10 06:40:26 on dist-test-slave-bw88"
server_key: "edb550390d3cb37d51b69179ea850f39"
server_key_iv: "20ababf397f38ce121464fdaad8aae29"
server_key_version: "encryptionkey@0"
I20260810 06:40:26.047441 29427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "4fc516aaed074d3a9c19f8c7678f2a61"
format_stamp: "Formatted at 2026-08-10 06:40:26 on dist-test-slave-bw88"
server_key: "edb550390d3cb37d51b69179ea850f39"
server_key_iv: "20ababf397f38ce121464fdaad8aae29"
server_key_version: "encryptionkey@0"
I20260810 06:40:26.048694 29427 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:40:26.049401 29446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:26.049571 29427 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:26.049656 29427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "4fc516aaed074d3a9c19f8c7678f2a61"
format_stamp: "Formatted at 2026-08-10 06:40:26 on dist-test-slave-bw88"
server_key: "edb550390d3cb37d51b69179ea850f39"
server_key_iv: "20ababf397f38ce121464fdaad8aae29"
server_key_version: "encryptionkey@0"
I20260810 06:40:26.049726 29427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:26.059284 29427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:26.061121 29427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:26.061288 29427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:26.061820 29427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:26.061878 29427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:26.061925 29427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:26.061955 29427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:26.069410 29427 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:37783
Aug 10 06:40:26 dist-test-slave-bw88 krb5kdc[29265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344026, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:26.069499 29607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:37783 every 8 connection(s)
I20260810 06:40:26.069799 29427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:40:26.072703 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.062449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:43907 (local address 127.27.41.190:45291)
0810 06:40:26.062502 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.062504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.062750 (+ 246us) server_negotiation.cc:407] Connection header received
0810 06:40:26.063249 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.063251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.063263 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.063340 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:26.064316 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.065114 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.066861 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.067208 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.067294 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.070027 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:26.070028 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:26.070029 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:26.070037 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:26.071390 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.071803 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.071804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.071805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.071865 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.072158 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.072159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.072159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.072279 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:26.072336 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.072559 (+ 223us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.072639 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 06:40:26.072849 29461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.062450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45291 (local address 127.27.41.129:43907)
0810 06:40:26.062639 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.062673 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.063150 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.063452 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.063464 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.063870 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:26.064203 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.064211 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.065230 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.065231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.066766 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.066770 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.067328 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.067329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.067496 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.068069 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:26.068081 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:26.069912 (+ 1831us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:26.071486 (+ 1574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.071493 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.071495 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.071720 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.071928 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.071929 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.071929 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.072045 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.072335 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:26.072341 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:26.072451 (+ 110us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.072532 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.072652 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
I20260810 06:40:26.073381 29608 heartbeater.cc:347] Connected to a master server at 127.27.41.190:45291
I20260810 06:40:26.073478 29608 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:26.073662 29608 heartbeater.cc:511] Master 127.27.41.190:45291 requested a full tablet report, sending...
I20260810 06:40:26.074219 29331 ts_manager.cc:194] Registered new tserver with Master: 4fc516aaed074d3a9c19f8c7678f2a61 (127.27.41.129:37783)
I20260810 06:40:26.074913 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 29427
I20260810 06:40:26.075043 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:40:26.075182 29331 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:43907
I20260810 06:40:26.075233 27814 external_mini_cluster.cc:1428] Setting key c79f7a13271699577b9cbb53c0af2513
I20260810 06:40:26.080451 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.074556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:55407 (local address 127.27.41.190:45291)
0810 06:40:26.074596 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.074597 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.074678 (+ 81us) server_negotiation.cc:407] Connection header received
0810 06:40:26.074752 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.074753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.074763 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.074831 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:26.075176 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.075793 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.076669 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.076969 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.077038 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.077917 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:26.077918 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:26.077919 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:26.077927 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:26.079306 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.079704 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.079706 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.079706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.079766 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.079960 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.079961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.079962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.080068 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:26.080142 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.080288 (+ 146us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.080364 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 06:40:26.080457 29617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.074474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45291 (local address 127.27.41.129:55407)
0810 06:40:26.074618 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.074629 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.074687 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.074836 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.074837 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.075049 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:26.075111 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.075112 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.075890 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.075891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.076598 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.076600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.077058 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.077059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.077113 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.077573 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:26.077577 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:26.077836 (+ 259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:26.079381 (+ 1545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.079382 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.079383 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.079629 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.079831 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.079832 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.079832 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.079893 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.080134 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:26.080135 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:26.080181 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.080263 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.080366 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:40:26.102182 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:45291
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:41493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:26.187811 29622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:26.188036 29622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:26.188073 29622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:26.189219 29622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:26.189281 29622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:26.189318 29622 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:40:26.189370 29622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:26.190840 29622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:41493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.41.190:45291
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:26.191109 29622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:26.191327 29622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:26.196408 29631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:26.196461 29622 server_base.cc:1034] running on GCE node
W20260810 06:40:26.196434 29630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:26.196434 29633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:26.196839 29622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:26.197214 29622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:26.198364 29622 hybrid_clock.cc:648] HybridClock initialized: now 1786344026198353 us; error 27 us; skew 500 ppm
Aug 10 06:40:26 dist-test-slave-bw88 krb5kdc[29265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344026, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:26.200852 29622 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:40:26.201320 29622 webserver.cc:460] Webserver started at http://127.27.41.130:42701/ using document root <none> and password file <none>
I20260810 06:40:26.201614 29622 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:26.201660 29622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:26.201821 29622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:26.202848 29622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "1d849e025ad446e2bed896dbc32d5a81"
format_stamp: "Formatted at 2026-08-10 06:40:26 on dist-test-slave-bw88"
server_key: "565c538f2db4c3ca285d3839adc289ec"
server_key_iv: "2c3b828a7dadc3d34ad1cd5bda872df3"
server_key_version: "encryptionkey@0"
I20260810 06:40:26.203198 29622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "1d849e025ad446e2bed896dbc32d5a81"
format_stamp: "Formatted at 2026-08-10 06:40:26 on dist-test-slave-bw88"
server_key: "565c538f2db4c3ca285d3839adc289ec"
server_key_iv: "2c3b828a7dadc3d34ad1cd5bda872df3"
server_key_version: "encryptionkey@0"
I20260810 06:40:26.204619 29622 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:26.205365 29642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:26.205529 29622 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:26.205621 29622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "1d849e025ad446e2bed896dbc32d5a81"
format_stamp: "Formatted at 2026-08-10 06:40:26 on dist-test-slave-bw88"
server_key: "565c538f2db4c3ca285d3839adc289ec"
server_key_iv: "2c3b828a7dadc3d34ad1cd5bda872df3"
server_key_version: "encryptionkey@0"
I20260810 06:40:26.205690 29622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:26.222463 29622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:26.224308 29622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:26.224571 29622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:26.225200 29622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:26.225258 29622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:26.225292 29622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:26.225309 29622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 06:40:26 dist-test-slave-bw88 krb5kdc[29265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344026, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:26.233273 29622 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:38745
I20260810 06:40:26.233654 29622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:40:26.233721 29798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:38745 every 8 connection(s)
I20260810 06:40:26.235814 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.225590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:51551 (local address 127.27.41.190:45291)
0810 06:40:26.225649 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.225652 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.225871 (+ 219us) server_negotiation.cc:407] Connection header received
0810 06:40:26.226410 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.226411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.226425 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.226486 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:26.227130 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.227881 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.228987 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.229203 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.229282 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.232821 (+ 3539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:26.232823 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:26.232824 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:26.232832 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:26.234425 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.234857 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.234858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.234859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.234919 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.235167 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.235168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.235169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.235295 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:26.235371 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.235639 (+ 268us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.235724 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 06:40:26.236003 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.225571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45291 (local address 127.27.41.130:51551)
0810 06:40:26.225729 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.225786 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.226304 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.226577 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.226582 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.226837 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:26.227016 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.227020 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.228006 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.228007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.228881 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.228883 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.229291 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.229292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.229443 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.229991 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:26.230002 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:26.232723 (+ 2721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:26.234546 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.234555 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.234557 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.234780 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.234989 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.234990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.234991 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.235100 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.235361 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:26.235369 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:26.235510 (+ 141us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.235616 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.235773 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":75,"threads_started":1}
I20260810 06:40:26.236474 29799 heartbeater.cc:347] Connected to a master server at 127.27.41.190:45291
I20260810 06:40:26.236557 29799 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:26.236748 29799 heartbeater.cc:511] Master 127.27.41.190:45291 requested a full tablet report, sending...
I20260810 06:40:26.237149 29332 ts_manager.cc:194] Registered new tserver with Master: 1d849e025ad446e2bed896dbc32d5a81 (127.27.41.130:38745)
I20260810 06:40:26.237634 29332 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:51551
I20260810 06:40:26.237864 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 29622
I20260810 06:40:26.237967 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:40:26.238178 27814 external_mini_cluster.cc:1428] Setting key 7c7679a5079ee9e00277121387e8a3c6
I20260810 06:40:26.243698 29805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.237595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45291 (local address 127.27.41.130:56839)
0810 06:40:26.237732 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.237743 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.237802 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.237986 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.237987 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.238288 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:26.238358 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.238360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.239202 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.239203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.239691 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.239692 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.240152 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.240153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.240211 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.240619 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:26.240625 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:26.241019 (+ 394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:26.242711 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.242712 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.242713 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.242870 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.243077 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.243078 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.243078 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.243129 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.243477 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:26.243478 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:26.243512 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.243559 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.243632 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":72,"threads_started":1}
I20260810 06:40:26.243784 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.237638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:56839 (local address 127.27.41.190:45291)
0810 06:40:26.237674 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.237676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.237791 (+ 115us) server_negotiation.cc:407] Connection header received
0810 06:40:26.237858 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.237859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.237868 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.237921 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:26.238463 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.239113 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.239767 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.240072 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.240135 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.241107 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:26.241108 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:26.241108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:26.241114 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:26.242622 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.242947 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.242948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.242949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.243008 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.243191 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.243192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.243192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.243401 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:26.243489 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.243590 (+ 101us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.243670 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:40:26.264248 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:45291
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:41493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:26.347792 29809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:26.347986 29809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:26.348008 29809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:26.349164 29809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:26.349205 29809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:26.349225 29809 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:40:26.349243 29809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:26.350683 29809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:41493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.41.190:45291
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:26.350857 29809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:26.351022 29809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:26.356122 29818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:26.356175 29809 server_base.cc:1034] running on GCE node
W20260810 06:40:26.356177 29815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:26.356130 29816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:26.356511 29809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:26.356781 29809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:26.357932 29809 hybrid_clock.cc:648] HybridClock initialized: now 1786344026357926 us; error 32 us; skew 500 ppm
Aug 10 06:40:26 dist-test-slave-bw88 krb5kdc[29265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344026, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:26.360455 29809 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:40:26.360857 29809 webserver.cc:460] Webserver started at http://127.27.41.131:40705/ using document root <none> and password file <none>
I20260810 06:40:26.361119 29809 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:26.361194 29809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:26.361366 29809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:26.362471 29809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3"
format_stamp: "Formatted at 2026-08-10 06:40:26 on dist-test-slave-bw88"
server_key: "9b3dde86fad13bbbb9d2a8d8eb4086e1"
server_key_iv: "12608a3db05044bcd9ecb0bf4045b4d9"
server_key_version: "encryptionkey@0"
I20260810 06:40:26.362859 29809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3"
format_stamp: "Formatted at 2026-08-10 06:40:26 on dist-test-slave-bw88"
server_key: "9b3dde86fad13bbbb9d2a8d8eb4086e1"
server_key_iv: "12608a3db05044bcd9ecb0bf4045b4d9"
server_key_version: "encryptionkey@0"
I20260810 06:40:26.364149 29809 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:40:26.364828 29829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:26.364987 29809 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:26.365074 29809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3"
format_stamp: "Formatted at 2026-08-10 06:40:26 on dist-test-slave-bw88"
server_key: "9b3dde86fad13bbbb9d2a8d8eb4086e1"
server_key_iv: "12608a3db05044bcd9ecb0bf4045b4d9"
server_key_version: "encryptionkey@0"
I20260810 06:40:26.365146 29809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:26.372712 29809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:26.374600 29809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:26.374784 29809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:26.375264 29809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:26.375306 29809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:26.375329 29809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:26.375370 29809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 06:40:26 dist-test-slave-bw88 krb5kdc[29265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344026, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:26.382486 29809 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:45135
I20260810 06:40:26.382615 29969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:45135 every 8 connection(s)
I20260810 06:40:26.382867 29809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:40:26.385655 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.375800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:58175 (local address 127.27.41.190:45291)
0810 06:40:26.375891 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.375895 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.376077 (+ 182us) server_negotiation.cc:407] Connection header received
0810 06:40:26.376529 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.376530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.376544 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.376627 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:26.377480 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.378021 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.379688 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.380056 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.380143 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.382961 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:26.382962 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:26.382963 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:26.382970 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:26.384454 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.384840 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.384841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.384841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.384889 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.385120 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.385120 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.385121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.385231 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:26.385278 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.385535 (+ 257us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.385595 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 06:40:26.385893 29839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.375760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45291 (local address 127.27.41.131:58175)
0810 06:40:26.375952 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.375991 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.376441 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.376730 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.376734 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.377062 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:26.377338 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.377344 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.378151 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.378151 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.379575 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.379578 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.380168 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.380169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.380298 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.381133 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:26.381149 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:26.382862 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:26.384554 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.384559 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.384560 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.384768 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.384973 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.384974 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.384974 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.385069 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.385280 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:26.385284 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:26.385442 (+ 158us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.385522 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.385650 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":124,"threads_started":1}
I20260810 06:40:26.386379 29971 heartbeater.cc:347] Connected to a master server at 127.27.41.190:45291
I20260810 06:40:26.386467 29971 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:26.386663 29971 heartbeater.cc:511] Master 127.27.41.190:45291 requested a full tablet report, sending...
I20260810 06:40:26.387058 29331 ts_manager.cc:194] Registered new tserver with Master: bb8f0cdd063b4ef7b423dd14afe2e4f3 (127.27.41.131:45135)
I20260810 06:40:26.387524 29331 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:58175
I20260810 06:40:26.389297 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 29809
I20260810 06:40:26.389430 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:40:26.389604 27814 external_mini_cluster.cc:1428] Setting key b117f4acd0fb119193f882f2c16aaccb
I20260810 06:40:26.390527 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:40:26.393319 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.387458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:43951 (local address 127.27.41.190:45291)
0810 06:40:26.387498 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.387500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.387565 (+ 65us) server_negotiation.cc:407] Connection header received
0810 06:40:26.387654 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.387655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.387665 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.387696 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:26.388115 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.388654 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.389377 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.389678 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.389751 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.390816 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:26.390817 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:26.390817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:26.390823 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:26.392119 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.392506 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.392508 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.392508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.392571 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.392808 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.392810 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.392810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.392922 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:26.393013 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.393164 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.393234 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 06:40:26.393334 29979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.387386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45291 (local address 127.27.41.131:43951)
0810 06:40:26.387507 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.387517 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.387574 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.387754 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.387755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.387973 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:26.388043 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.388044 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.388775 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.388775 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.389287 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.389288 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.389830 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.389831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.389914 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.390350 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:26.390368 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:26.390744 (+ 376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:26.392197 (+ 1453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.392198 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.392199 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.392428 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.392651 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.392651 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.392652 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.392739 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.392987 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:26.392988 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:26.393052 (+ 64us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.393136 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.393236 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":61,"threads_started":1}
Aug 10 06:40:26 dist-test-slave-bw88 krb5kdc[29265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344026, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 06:40:26 dist-test-slave-bw88 krb5kdc[29265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344026, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:26.413858 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.407422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55262 (local address 127.27.41.190:45291)
0810 06:40:26.407463 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.407465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.407493 (+ 28us) server_negotiation.cc:407] Connection header received
0810 06:40:26.407513 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.407513 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.407522 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.407576 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:26.408137 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.408680 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.409434 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.409623 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.409676 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.411708 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:26.411709 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:26.411710 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:26.411716 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:26.412834 (+ 1118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.413180 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.413181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.413181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.413229 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.413472 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.413472 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.413472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.413578 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:26.413654 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.413743 (+ 89us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.413799 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:40:26.415573 29331 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:40:26.417183 29331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:26.423574 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.419393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:38745 (local address 127.0.0.1:60446)
0810 06:40:26.419578 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.419617 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.419684 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.420020 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.420024 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.420026 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:26.420089 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.420091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.421465 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.421466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.422554 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.422558 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.423276 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.423277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.423356 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.423368 (+ 12us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.423432 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.423496 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":3,"thread_start_us":76,"threads_started":1}
I20260810 06:40:26.423624 29993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.419507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60446 (local address 127.27.41.130:38745)
0810 06:40:26.419834 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.419840 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.419851 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:40:26.419891 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.419894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.419908 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.420014 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:26.420180 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.421379 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.422659 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.423172 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.423270 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.423334 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.423482 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.423519 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":86,"threads_started":1}
I20260810 06:40:26.423848 29991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.419404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:45135 (local address 127.0.0.1:41962)
0810 06:40:26.419798 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.419806 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.419843 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.420176 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.420177 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.420178 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:26.420221 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.420223 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.421225 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.421226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.422610 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.422612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.423561 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.423562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.423645 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.423649 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.423708 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.423760 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":28,"thread_start_us":57,"threads_started":1}
I20260810 06:40:26.424055 29990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.419404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:37783 (local address 127.0.0.1:48654)
0810 06:40:26.419677 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.419688 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.419729 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.420293 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.420294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.420296 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:26.420357 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.420358 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.421619 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.421620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.422526 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.422528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.423557 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.423559 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.423800 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.423803 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.423857 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.423983 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":2,"thread_start_us":54,"threads_started":1}
I20260810 06:40:26.424052 29996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.419673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48654 (local address 127.27.41.129:37783)
0810 06:40:26.419843 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.419847 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.419856 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:26.419899 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.419901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.419915 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.420169 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:26.420431 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.421538 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.422621 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.423392 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.423466 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.423518 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.423894 (+ 376us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.423951 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":70,"threads_started":1}
I20260810 06:40:26.424173 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.419656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41962 (local address 127.27.41.131:45135)
0810 06:40:26.419838 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.419843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.419856 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:40:26.419898 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.419900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.419915 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.420024 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:26.420442 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.421123 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.422684 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.423393 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.423466 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.423518 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.424016 (+ 498us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.424057 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":77,"threads_started":1}
I20260810 06:40:26.424533 29714 tablet_service.cc:1467] Processing CreateTablet for tablet f82618bf7d604fac830e548443e93467 (DEFAULT_TABLE table=test-table [id=aeea5260bc1c4006a2388b5024266e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:26.424841 29894 tablet_service.cc:1467] Processing CreateTablet for tablet f82618bf7d604fac830e548443e93467 (DEFAULT_TABLE table=test-table [id=aeea5260bc1c4006a2388b5024266e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:26.424935 29714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f82618bf7d604fac830e548443e93467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:26.424911 29519 tablet_service.cc:1467] Processing CreateTablet for tablet f82618bf7d604fac830e548443e93467 (DEFAULT_TABLE table=test-table [id=aeea5260bc1c4006a2388b5024266e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:26.425203 29894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f82618bf7d604fac830e548443e93467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:26.425290 29519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f82618bf7d604fac830e548443e93467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:26.427801 29997 tablet_bootstrap.cc:492] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3: Bootstrap starting.
I20260810 06:40:26.428612 29997 tablet_bootstrap.cc:654] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:26.428948 30000 tablet_bootstrap.cc:492] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61: Bootstrap starting.
I20260810 06:40:26.429011 29997 log.cc:824] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:26.429461 29998 tablet_bootstrap.cc:492] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81: Bootstrap starting.
I20260810 06:40:26.429737 30000 tablet_bootstrap.cc:654] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:26.430074 29997 tablet_bootstrap.cc:492] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3: No bootstrap required, opened a new log
I20260810 06:40:26.430105 30000 log.cc:824] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:26.430141 29998 tablet_bootstrap.cc:654] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:26.430148 29997 ts_tablet_manager.cc:1397] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:40:26.430529 29998 log.cc:824] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:26.430984 30000 tablet_bootstrap.cc:492] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61: No bootstrap required, opened a new log
I20260810 06:40:26.431058 30000 ts_tablet_manager.cc:1397] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 06:40:26.431278 29998 tablet_bootstrap.cc:492] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81: No bootstrap required, opened a new log
I20260810 06:40:26.431356 29998 ts_tablet_manager.cc:1397] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 06:40:26.432250 29997 raft_consensus.cc:348] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } }
I20260810 06:40:26.432425 29997 raft_consensus.cc:374] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:26.432466 29997 raft_consensus.cc:729] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8f0cdd063b4ef7b423dd14afe2e4f3, State: Initialized, Role: FOLLOWER
I20260810 06:40:26.432603 29997 consensus_queue.cc:260] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } }
I20260810 06:40:26.432868 29997 ts_tablet_manager.cc:1428] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:40:26.433019 29971 heartbeater.cc:503] Master 127.27.41.190:45291 was elected leader, sending a full tablet report...
I20260810 06:40:26.433068 29998 raft_consensus.cc:348] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } }
I20260810 06:40:26.433208 29998 raft_consensus.cc:374] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:26.433141 30000 raft_consensus.cc:348] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } }
I20260810 06:40:26.433239 29998 raft_consensus.cc:729] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d849e025ad446e2bed896dbc32d5a81, State: Initialized, Role: FOLLOWER
I20260810 06:40:26.433250 30000 raft_consensus.cc:374] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:26.433293 30000 raft_consensus.cc:729] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fc516aaed074d3a9c19f8c7678f2a61, State: Initialized, Role: FOLLOWER
I20260810 06:40:26.433418 29998 consensus_queue.cc:260] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } }
I20260810 06:40:26.433459 30000 consensus_queue.cc:260] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } }
I20260810 06:40:26.433750 30000 ts_tablet_manager.cc:1428] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260810 06:40:26.433779 29799 heartbeater.cc:503] Master 127.27.41.190:45291 was elected leader, sending a full tablet report...
I20260810 06:40:26.433869 29608 heartbeater.cc:503] Master 127.27.41.190:45291 was elected leader, sending a full tablet report...
I20260810 06:40:26.433738 29998 ts_tablet_manager.cc:1428] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
W20260810 06:40:26.484334 29800 tablet.cc:2369] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:40:26.527951 30008 raft_consensus.cc:482] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:26.528126 30008 raft_consensus.cc:504] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } }
I20260810 06:40:26.528564 30008 leader_election.cc:288] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d849e025ad446e2bed896dbc32d5a81 (127.27.41.130:38745), bb8f0cdd063b4ef7b423dd14afe2e4f3 (127.27.41.131:45135)
I20260810 06:40:26.531535 29993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.528851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:60765 (local address 127.27.41.130:38745)
0810 06:40:26.528895 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.528897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.528908 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:40:26.528996 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.528997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.529006 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.529078 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:26.529245 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.529816 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.530771 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.531166 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.531245 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.531255 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.531432 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.531468 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 06:40:26.531562 29461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.528776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:38745 (local address 127.27.41.129:60765)
0810 06:40:26.528854 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.528866 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.528916 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.529083 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.529084 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.529086 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:26.529173 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.529175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.529911 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.529911 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.530680 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.530682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.531254 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.531255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.531353 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.531356 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.531418 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.531459 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260810 06:40:26.531596 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.528848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:35793 (local address 127.27.41.131:45135)
0810 06:40:26.528913 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.528915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.529081 (+ 166us) server_negotiation.cc:407] Connection header received
0810 06:40:26.529180 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.529181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.529190 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.529248 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:26.529423 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.529896 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.530805 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.531236 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.531317 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.531325 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.531475 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.531514 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 06:40:26.531823 30007 raft_consensus.cc:482] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:26.531849 30009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.528792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:45135 (local address 127.27.41.129:35793)
0810 06:40:26.528996 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.529005 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.529102 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.529253 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.529253 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.529254 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:26.529352 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.529354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.529983 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.529984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.530711 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.530713 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.531317 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.531318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.531402 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.531405 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.531469 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.531509 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":145,"threads_started":1}
I20260810 06:40:26.531908 29739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f82618bf7d604fac830e548443e93467" candidate_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d849e025ad446e2bed896dbc32d5a81" is_pre_election: true
I20260810 06:40:26.531916 30007 raft_consensus.cc:504] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } }
I20260810 06:40:26.532135 29739 raft_consensus.cc:2454] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fc516aaed074d3a9c19f8c7678f2a61 in term 0.
I20260810 06:40:26.532321 30007 leader_election.cc:288] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8f0cdd063b4ef7b423dd14afe2e4f3 (127.27.41.131:45135), 4fc516aaed074d3a9c19f8c7678f2a61 (127.27.41.129:37783)
I20260810 06:40:26.532316 29917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f82618bf7d604fac830e548443e93467" candidate_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" is_pre_election: true
I20260810 06:40:26.532473 29917 raft_consensus.cc:2454] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fc516aaed074d3a9c19f8c7678f2a61 in term 0.
I20260810 06:40:26.532552 29451 leader_election.cc:302] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d849e025ad446e2bed896dbc32d5a81, 4fc516aaed074d3a9c19f8c7678f2a61; no voters:
I20260810 06:40:26.532680 30008 raft_consensus.cc:2781] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:26.532760 30008 raft_consensus.cc:482] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:26.532792 30008 raft_consensus.cc:3037] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:26.534082 30008 raft_consensus.cc:504] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } }
I20260810 06:40:26.534370 29917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f82618bf7d604fac830e548443e93467" candidate_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3"
I20260810 06:40:26.534391 29739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f82618bf7d604fac830e548443e93467" candidate_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d849e025ad446e2bed896dbc32d5a81"
I20260810 06:40:26.534466 29739 raft_consensus.cc:3037] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:26.534472 29917 raft_consensus.cc:3037] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:26.535403 29917 raft_consensus.cc:2454] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fc516aaed074d3a9c19f8c7678f2a61 in term 1.
I20260810 06:40:26.535413 29739 raft_consensus.cc:2454] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fc516aaed074d3a9c19f8c7678f2a61 in term 1.
I20260810 06:40:26.535580 29447 leader_election.cc:302] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fc516aaed074d3a9c19f8c7678f2a61, bb8f0cdd063b4ef7b423dd14afe2e4f3; no voters:
I20260810 06:40:26.535740 30008 leader_election.cc:288] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [CANDIDATE]: Term 1 election: Requested vote from peers 1d849e025ad446e2bed896dbc32d5a81 (127.27.41.130:38745), bb8f0cdd063b4ef7b423dd14afe2e4f3 (127.27.41.131:45135)
I20260810 06:40:26.535840 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.532436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:37783 (local address 127.27.41.130:33133)
0810 06:40:26.532488 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.532497 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.532532 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.532913 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.532914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.532916 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:26.532974 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.532975 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.533812 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.533813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.534820 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.534823 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.535580 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.535580 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.535666 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.535669 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.535719 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.535763 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 06:40:26.535820 30011 raft_consensus.cc:2781] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:26.536065 29996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.532724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:33133 (local address 127.27.41.129:37783)
0810 06:40:26.532771 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.532774 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.532781 (+ 7us) server_negotiation.cc:407] Connection header received
0810 06:40:26.532802 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.532803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.532814 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.532869 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:26.533052 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.533719 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.534924 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.535465 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.535537 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.535546 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.535926 (+ 380us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.535973 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 06:40:26.536199 30011 raft_consensus.cc:686] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 1 LEADER]: Becoming Leader. State: Replica: 4fc516aaed074d3a9c19f8c7678f2a61, State: Running, Role: LEADER
I20260810 06:40:26.536291 29543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f82618bf7d604fac830e548443e93467" candidate_uuid: "1d849e025ad446e2bed896dbc32d5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" is_pre_election: true
I20260810 06:40:26.536331 30011 consensus_queue.cc:237] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } }
I20260810 06:40:26.536770 30010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.532437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:45135 (local address 127.27.41.130:42743)
0810 06:40:26.532942 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.532952 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.533036 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.533156 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.533157 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.533158 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:26.533256 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.533257 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.533866 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.533867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.535373 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.535376 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.536398 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.536398 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.536512 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.536515 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.536613 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.536660 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"mutex_wait_us":313,"thread_start_us":125,"threads_started":1}
I20260810 06:40:26.536839 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.532526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:42743 (local address 127.27.41.131:45135)
0810 06:40:26.532604 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.532606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.533023 (+ 417us) server_negotiation.cc:407] Connection header received
0810 06:40:26.533088 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.533089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.533097 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.533152 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:26.533322 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.533796 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.535502 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.536293 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.536336 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.536343 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.536735 (+ 392us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.536774 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 06:40:26.537001 29917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f82618bf7d604fac830e548443e93467" candidate_uuid: "1d849e025ad446e2bed896dbc32d5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" is_pre_election: true
I20260810 06:40:26.537103 29917 raft_consensus.cc:2379] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d849e025ad446e2bed896dbc32d5a81 in current term 1: Already voted for candidate 4fc516aaed074d3a9c19f8c7678f2a61 in this term.
I20260810 06:40:26.537308 29643 leader_election.cc:302] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d849e025ad446e2bed896dbc32d5a81; no voters: 4fc516aaed074d3a9c19f8c7678f2a61, bb8f0cdd063b4ef7b423dd14afe2e4f3
I20260810 06:40:26.537462 30007 raft_consensus.cc:2726] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 06:40:26.537398 29332 catalog_manager.cc:5495] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fc516aaed074d3a9c19f8c7678f2a61 (127.27.41.129). New cstate: current_term: 1 leader_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } health_report { overall_health: HEALTHY } } }
W20260810 06:40:26.570676 29609 tablet.cc:2369] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:40:26.570865 29996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.568290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48662 (local address 127.27.41.129:37783)
0810 06:40:26.568357 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.568359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.568368 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:26.568443 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.568443 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.568460 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.568516 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:26.568651 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.569150 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.570060 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.570239 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.570286 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.570483 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:26.570592 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:26.570648 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.570727 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.570745 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 06:40:26.572726 29917 raft_consensus.cc:1261] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 1 FOLLOWER]: Refusing update from remote peer 4fc516aaed074d3a9c19f8c7678f2a61: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:26.572747 29739 raft_consensus.cc:1261] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [term 1 FOLLOWER]: Refusing update from remote peer 4fc516aaed074d3a9c19f8c7678f2a61: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:26.573055 30008 consensus_queue.cc:1035] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:26.573231 30011 consensus_queue.cc:1035] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:26.576045 30018 mvcc.cc:205] Tried to move back new op lower bound from 7316865132839047168 to 7316865132693532672. Current Snapshot: MvccSnapshot[applied={T|T < 7316865132839047168}]
I20260810 06:40:26.579408 29332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:26.579514 29332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:26.580276 29332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d: Sending DeleteTablet for 3 replicas of tablet f82618bf7d604fac830e548443e93467
I20260810 06:40:26.580603 29714 tablet_service.cc:1514] Processing DeleteTablet for tablet f82618bf7d604fac830e548443e93467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:26 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:60446
I20260810 06:40:26.580649 29519 tablet_service.cc:1514] Processing DeleteTablet for tablet f82618bf7d604fac830e548443e93467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:26 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:48654
I20260810 06:40:26.580678 29894 tablet_service.cc:1514] Processing DeleteTablet for tablet f82618bf7d604fac830e548443e93467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:26 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:41962
I20260810 06:40:26.580926 30029 tablet_replica.cc:330] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61: stopping tablet replica
I20260810 06:40:26.581156 30028 tablet_replica.cc:330] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81: stopping tablet replica
I20260810 06:40:26.581177 29332 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 06:40:26.581259 30028 raft_consensus.cc:2229] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 06:40:26.581354 29332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:26.581398 30029 raft_consensus.cc:2229] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:40:26.581547 30029 raft_consensus.cc:2258] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:26.581677 30028 raft_consensus.cc:2258] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:26.582183 30029 ts_tablet_manager.cc:1905] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:26.582540 29519 tablet_service.cc:1467] Processing CreateTablet for tablet 6a2871eba5a9475ebebfb590e18f27ea (DEFAULT_TABLE table=test-table [id=b9806763d7374e269dd4cc9734035084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:26.582648 29519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a2871eba5a9475ebebfb590e18f27ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:26.582624 29894 tablet_service.cc:1467] Processing CreateTablet for tablet 6a2871eba5a9475ebebfb590e18f27ea (DEFAULT_TABLE table=test-table [id=b9806763d7374e269dd4cc9734035084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:26.582638 29714 tablet_service.cc:1467] Processing CreateTablet for tablet 6a2871eba5a9475ebebfb590e18f27ea (DEFAULT_TABLE table=test-table [id=b9806763d7374e269dd4cc9734035084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:26.582736 29894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a2871eba5a9475ebebfb590e18f27ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:26.582742 29714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a2871eba5a9475ebebfb590e18f27ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:26.583652 29997 tablet_bootstrap.cc:492] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3: Bootstrap starting.
I20260810 06:40:26.584003 30000 tablet_bootstrap.cc:492] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61: Bootstrap starting.
I20260810 06:40:26.584039 29998 tablet_bootstrap.cc:492] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81: Bootstrap starting.
I20260810 06:40:26.584272 29997 tablet_bootstrap.cc:654] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:26.584451 30000 tablet_bootstrap.cc:654] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:26.584460 29998 tablet_bootstrap.cc:654] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:26.585192 30028 ts_tablet_manager.cc:1905] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:26.585215 30000 tablet_bootstrap.cc:492] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61: No bootstrap required, opened a new log
I20260810 06:40:26.585248 29997 tablet_bootstrap.cc:492] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3: No bootstrap required, opened a new log
I20260810 06:40:26.585261 30000 ts_tablet_manager.cc:1397] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260810 06:40:26.585309 29997 ts_tablet_manager.cc:1397] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:40:26.585431 30000 raft_consensus.cc:348] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.585495 30000 raft_consensus.cc:374] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:26.585517 30000 raft_consensus.cc:729] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fc516aaed074d3a9c19f8c7678f2a61, State: Initialized, Role: FOLLOWER
I20260810 06:40:26.585490 29997 raft_consensus.cc:348] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.585569 29997 raft_consensus.cc:374] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:26.585592 29997 raft_consensus.cc:729] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8f0cdd063b4ef7b423dd14afe2e4f3, State: Initialized, Role: FOLLOWER
I20260810 06:40:26.585564 30000 consensus_queue.cc:260] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.585637 29997 consensus_queue.cc:260] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.585659 30000 ts_tablet_manager.cc:1428] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:26.585724 29997 ts_tablet_manager.cc:1428] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:26.586261 29998 tablet_bootstrap.cc:492] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81: No bootstrap required, opened a new log
I20260810 06:40:26.586336 29998 ts_tablet_manager.cc:1397] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 06:40:26.586356 30031 tablet_replica.cc:330] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3: stopping tablet replica
I20260810 06:40:26.586468 30031 raft_consensus.cc:2229] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:26.586486 29998 raft_consensus.cc:348] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.586567 30031 raft_consensus.cc:2258] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:26.586580 29998 raft_consensus.cc:374] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:26.586606 29998 raft_consensus.cc:729] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d849e025ad446e2bed896dbc32d5a81, State: Initialized, Role: FOLLOWER
I20260810 06:40:26.586649 29998 consensus_queue.cc:260] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.586728 29998 ts_tablet_manager.cc:1428] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:26.586989 30031 ts_tablet_manager.cc:1905] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:26.588548 30031 ts_tablet_manager.cc:1918] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:26.588630 30031 log.cc:1196] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/f82618bf7d604fac830e548443e93467
I20260810 06:40:26.588900 30031 ts_tablet_manager.cc:1939] T f82618bf7d604fac830e548443e93467 P bb8f0cdd063b4ef7b423dd14afe2e4f3: Deleting consensus metadata
I20260810 06:40:26.589308 29310 catalog_manager.cc:4841] TS bb8f0cdd063b4ef7b423dd14afe2e4f3 (127.27.41.131:45135): tablet f82618bf7d604fac830e548443e93467 (table test-table [id=aeea5260bc1c4006a2388b5024266e12]) successfully deleted
I20260810 06:40:26.590950 30028 ts_tablet_manager.cc:1918] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:26.591012 30028 log.cc:1196] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/f82618bf7d604fac830e548443e93467
I20260810 06:40:26.591259 30028 ts_tablet_manager.cc:1939] T f82618bf7d604fac830e548443e93467 P 1d849e025ad446e2bed896dbc32d5a81: Deleting consensus metadata
I20260810 06:40:26.591629 30029 ts_tablet_manager.cc:1918] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:26.591650 29314 catalog_manager.cc:4841] TS 1d849e025ad446e2bed896dbc32d5a81 (127.27.41.130:38745): tablet f82618bf7d604fac830e548443e93467 (table test-table [id=aeea5260bc1c4006a2388b5024266e12]) successfully deleted
I20260810 06:40:26.591706 30029 log.cc:1196] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/wal/wals/f82618bf7d604fac830e548443e93467
I20260810 06:40:26.591918 30029 ts_tablet_manager.cc:1939] T f82618bf7d604fac830e548443e93467 P 4fc516aaed074d3a9c19f8c7678f2a61: Deleting consensus metadata
I20260810 06:40:26.592247 29315 catalog_manager.cc:4841] TS 4fc516aaed074d3a9c19f8c7678f2a61 (127.27.41.129:37783): tablet f82618bf7d604fac830e548443e93467 (table test-table [id=aeea5260bc1c4006a2388b5024266e12]) successfully deleted
I20260810 06:40:26.594430 30007 raft_consensus.cc:482] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:26.594501 30007 raft_consensus.cc:504] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.594638 30007 leader_election.cc:288] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4fc516aaed074d3a9c19f8c7678f2a61 (127.27.41.129:37783), bb8f0cdd063b4ef7b423dd14afe2e4f3 (127.27.41.131:45135)
I20260810 06:40:26.594817 29543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a2871eba5a9475ebebfb590e18f27ea" candidate_uuid: "1d849e025ad446e2bed896dbc32d5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" is_pre_election: true
I20260810 06:40:26.594830 29917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a2871eba5a9475ebebfb590e18f27ea" candidate_uuid: "1d849e025ad446e2bed896dbc32d5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" is_pre_election: true
I20260810 06:40:26.594892 29543 raft_consensus.cc:2454] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d849e025ad446e2bed896dbc32d5a81 in term 0.
I20260810 06:40:26.594904 29917 raft_consensus.cc:2454] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d849e025ad446e2bed896dbc32d5a81 in term 0.
I20260810 06:40:26.595070 29648 leader_election.cc:302] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d849e025ad446e2bed896dbc32d5a81, 4fc516aaed074d3a9c19f8c7678f2a61; no voters:
I20260810 06:40:26.595199 30007 raft_consensus.cc:2781] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:26.595235 30007 raft_consensus.cc:482] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:26.595258 30007 raft_consensus.cc:3037] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:26.595836 30007 raft_consensus.cc:504] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.595974 30007 leader_election.cc:288] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [CANDIDATE]: Term 1 election: Requested vote from peers 4fc516aaed074d3a9c19f8c7678f2a61 (127.27.41.129:37783), bb8f0cdd063b4ef7b423dd14afe2e4f3 (127.27.41.131:45135)
I20260810 06:40:26.596127 29543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a2871eba5a9475ebebfb590e18f27ea" candidate_uuid: "1d849e025ad446e2bed896dbc32d5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fc516aaed074d3a9c19f8c7678f2a61"
I20260810 06:40:26.596149 29917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a2871eba5a9475ebebfb590e18f27ea" candidate_uuid: "1d849e025ad446e2bed896dbc32d5a81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3"
I20260810 06:40:26.596210 29917 raft_consensus.cc:3037] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:26.596210 29543 raft_consensus.cc:3037] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:26.596900 29917 raft_consensus.cc:2454] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d849e025ad446e2bed896dbc32d5a81 in term 1.
I20260810 06:40:26.596964 29543 raft_consensus.cc:2454] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d849e025ad446e2bed896dbc32d5a81 in term 1.
I20260810 06:40:26.597105 29643 leader_election.cc:302] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d849e025ad446e2bed896dbc32d5a81, bb8f0cdd063b4ef7b423dd14afe2e4f3; no voters:
I20260810 06:40:26.597194 30007 raft_consensus.cc:2781] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:26.597394 30007 raft_consensus.cc:686] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [term 1 LEADER]: Becoming Leader. State: Replica: 1d849e025ad446e2bed896dbc32d5a81, State: Running, Role: LEADER
I20260810 06:40:26.597458 30007 consensus_queue.cc:237] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.598057 29330 catalog_manager.cc:5495] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d849e025ad446e2bed896dbc32d5a81 (127.27.41.130). New cstate: current_term: 1 leader_uuid: "1d849e025ad446e2bed896dbc32d5a81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } health_report { overall_health: UNKNOWN } } }
Aug 10 06:40:26 dist-test-slave-bw88 krb5kdc[29265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344025, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:26.629396 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.622251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55274 (local address 127.27.41.190:45291)
0810 06:40:26.622318 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.622320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.622447 (+ 127us) server_negotiation.cc:407] Connection header received
0810 06:40:26.622524 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.622525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.622554 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.622615 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:26.623104 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.623602 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.624297 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.624479 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.624583 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.626742 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:26.626743 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:26.626744 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:26.626751 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:26.628151 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.628527 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.628528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.628536 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.628591 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.628775 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.628776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.628777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.628886 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:26.628959 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.629117 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.629222 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 06:40:26.629477 30046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.622195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45291 (local address 127.0.0.1:55274)
0810 06:40:26.622365 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.622380 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.622468 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.622620 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.622621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.622950 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:26.623004 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.623007 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.623684 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.623685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.624212 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.624214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.624583 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.624584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.624653 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.625244 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:26.625249 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:26.626653 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:26.628241 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.628248 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.628251 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.628436 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.628654 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:26.628655 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:26.628656 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:26.628714 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:26.628950 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:26.628957 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:26.629003 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.629092 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.629283 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":88,"thread_start_us":88,"threads_started":1}
I20260810 06:40:26.632193 29330 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:55274:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 06:40:26.632442 29330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 06:40:26.633459 29973 tablet.cc:2369] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:40:26.634032 29519 tablet_service.cc:1467] Processing CreateTablet for tablet 82966cab095742248b30043ab58c6403 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=efa6e74c4c094a0a85991c14dfa2a63c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:40:26.634042 29714 tablet_service.cc:1467] Processing CreateTablet for tablet 82966cab095742248b30043ab58c6403 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=efa6e74c4c094a0a85991c14dfa2a63c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:40:26.634162 29894 tablet_service.cc:1467] Processing CreateTablet for tablet 82966cab095742248b30043ab58c6403 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=efa6e74c4c094a0a85991c14dfa2a63c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:40:26.634213 29714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82966cab095742248b30043ab58c6403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:26.634219 29519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82966cab095742248b30043ab58c6403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:26.634292 29894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82966cab095742248b30043ab58c6403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:26.635848 30000 tablet_bootstrap.cc:492] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61: Bootstrap starting.
I20260810 06:40:26.635865 29997 tablet_bootstrap.cc:492] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3: Bootstrap starting.
I20260810 06:40:26.636332 29997 tablet_bootstrap.cc:654] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:26.636366 30000 tablet_bootstrap.cc:654] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:26.636749 29998 tablet_bootstrap.cc:492] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81: Bootstrap starting.
I20260810 06:40:26.637208 29997 tablet_bootstrap.cc:492] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3: No bootstrap required, opened a new log
I20260810 06:40:26.637219 29998 tablet_bootstrap.cc:654] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:26.637269 29997 ts_tablet_manager.cc:1397] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:26.637454 29997 raft_consensus.cc:348] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.637537 29997 raft_consensus.cc:374] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:26.637559 29997 raft_consensus.cc:729] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8f0cdd063b4ef7b423dd14afe2e4f3, State: Initialized, Role: FOLLOWER
I20260810 06:40:26.637591 29997 consensus_queue.cc:260] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.637686 29997 ts_tablet_manager.cc:1428] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:26.637789 30006 tablet_replica.cc:439] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } }
I20260810 06:40:26.637898 30000 tablet_bootstrap.cc:492] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61: No bootstrap required, opened a new log
I20260810 06:40:26.637899 30006 tablet_replica.cc:442] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:26.637959 30000 ts_tablet_manager.cc:1397] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 06:40:26.638119 30000 raft_consensus.cc:348] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.638192 30000 raft_consensus.cc:374] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:26.638213 30000 raft_consensus.cc:729] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fc516aaed074d3a9c19f8c7678f2a61, State: Initialized, Role: FOLLOWER
I20260810 06:40:26.638254 30000 consensus_queue.cc:260] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.638347 30000 ts_tablet_manager.cc:1428] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:26.638382 30023 tablet_replica.cc:439] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } }
I20260810 06:40:26.638494 30023 tablet_replica.cc:442] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:26.638872 29998 tablet_bootstrap.cc:492] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81: No bootstrap required, opened a new log
I20260810 06:40:26.638937 29998 ts_tablet_manager.cc:1397] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:40:26.639268 29998 raft_consensus.cc:348] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.639349 29998 raft_consensus.cc:374] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:26.639379 29998 raft_consensus.cc:729] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d849e025ad446e2bed896dbc32d5a81, State: Initialized, Role: FOLLOWER
I20260810 06:40:26.639424 29998 consensus_queue.cc:260] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.639519 29998 ts_tablet_manager.cc:1428] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:26.639567 30007 tablet_replica.cc:439] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } }
I20260810 06:40:26.639668 30007 tablet_replica.cc:442] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:26.687425 30023 raft_consensus.cc:482] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:26.687546 30023 raft_consensus.cc:504] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.687748 30023 leader_election.cc:288] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d849e025ad446e2bed896dbc32d5a81 (127.27.41.130:38745), bb8f0cdd063b4ef7b423dd14afe2e4f3 (127.27.41.131:45135)
I20260810 06:40:26.687928 29917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82966cab095742248b30043ab58c6403" candidate_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" is_pre_election: true
I20260810 06:40:26.687938 29739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82966cab095742248b30043ab58c6403" candidate_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d849e025ad446e2bed896dbc32d5a81" is_pre_election: true
I20260810 06:40:26.688054 29739 raft_consensus.cc:2454] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fc516aaed074d3a9c19f8c7678f2a61 in term 0.
I20260810 06:40:26.688054 29917 raft_consensus.cc:2454] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fc516aaed074d3a9c19f8c7678f2a61 in term 0.
I20260810 06:40:26.688210 29447 leader_election.cc:302] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fc516aaed074d3a9c19f8c7678f2a61, bb8f0cdd063b4ef7b423dd14afe2e4f3; no voters:
I20260810 06:40:26.688299 30023 raft_consensus.cc:2781] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:26.688339 30023 raft_consensus.cc:482] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:26.688360 30023 raft_consensus.cc:3037] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:26.689128 30023 raft_consensus.cc:504] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.689265 30023 leader_election.cc:288] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [CANDIDATE]: Term 1 election: Requested vote from peers 1d849e025ad446e2bed896dbc32d5a81 (127.27.41.130:38745), bb8f0cdd063b4ef7b423dd14afe2e4f3 (127.27.41.131:45135)
I20260810 06:40:26.689477 29739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82966cab095742248b30043ab58c6403" candidate_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d849e025ad446e2bed896dbc32d5a81"
I20260810 06:40:26.689483 29917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82966cab095742248b30043ab58c6403" candidate_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3"
I20260810 06:40:26.689558 29739 raft_consensus.cc:3037] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:26.689558 29917 raft_consensus.cc:3037] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:26.690351 29739 raft_consensus.cc:2454] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fc516aaed074d3a9c19f8c7678f2a61 in term 1.
I20260810 06:40:26.690351 29917 raft_consensus.cc:2454] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fc516aaed074d3a9c19f8c7678f2a61 in term 1.
I20260810 06:40:26.690526 29451 leader_election.cc:302] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d849e025ad446e2bed896dbc32d5a81, 4fc516aaed074d3a9c19f8c7678f2a61; no voters:
I20260810 06:40:26.690636 30023 raft_consensus.cc:2781] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:26.690682 30023 raft_consensus.cc:686] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [term 1 LEADER]: Becoming Leader. State: Replica: 4fc516aaed074d3a9c19f8c7678f2a61, State: Running, Role: LEADER
I20260810 06:40:26.690742 30023 consensus_queue.cc:237] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } }
I20260810 06:40:26.691057 30008 tablet_replica.cc:439] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61: TxnStatusTablet state changed. Reason: New leader 4fc516aaed074d3a9c19f8c7678f2a61. Latest consensus state: current_term: 1 leader_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } }
I20260810 06:40:26.691149 30008 tablet_replica.cc:442] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:40:26.691330 30054 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 06:40:26.691483 30054 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 06:40:26.691612 29330 catalog_manager.cc:5495] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fc516aaed074d3a9c19f8c7678f2a61 (127.27.41.129). New cstate: current_term: 1 leader_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } health_report { overall_health: UNKNOWN } } }
I20260810 06:40:26.702489 29996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.699647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48676 (local address 127.27.41.129:37783)
0810 06:40:26.699696 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.699699 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.699710 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:40:26.699776 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.699777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.699789 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.699867 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:26.699986 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.700792 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.701633 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.701948 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.702023 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.702178 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:26.702213 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:26.702264 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.702369 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.702392 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 06:40:26.702569 30046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.699578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:37783 (local address 127.0.0.1:48676)
0810 06:40:26.699653 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.699665 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.699716 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.699871 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.699871 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.699872 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:40:26.699933 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.699935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.700895 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.700896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.701554 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.701556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.702032 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.702033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.702089 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.702107 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:40:26.702300 (+ 193us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:40:26.702309 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.702366 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.702459 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 06:40:26.703524 29917 raft_consensus.cc:1261] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 1 FOLLOWER]: Refusing update from remote peer 4fc516aaed074d3a9c19f8c7678f2a61: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:26.703549 29739 raft_consensus.cc:1261] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81 [term 1 FOLLOWER]: Refusing update from remote peer 4fc516aaed074d3a9c19f8c7678f2a61: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:26.703735 30023 consensus_queue.cc:1035] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:26.703826 30008 consensus_queue.cc:1035] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:26.704407 30006 tablet_replica.cc:439] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3: TxnStatusTablet state changed. Reason: New leader 4fc516aaed074d3a9c19f8c7678f2a61. Latest consensus state: current_term: 1 leader_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } }
I20260810 06:40:26.704533 30006 tablet_replica.cc:442] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:26.704543 30007 tablet_replica.cc:439] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81: TxnStatusTablet state changed. Reason: New leader 4fc516aaed074d3a9c19f8c7678f2a61. Latest consensus state: current_term: 1 leader_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } }
I20260810 06:40:26.704638 30007 tablet_replica.cc:442] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:26.705423 30008 tablet_replica.cc:439] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } }
I20260810 06:40:26.705493 30008 tablet_replica.cc:442] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:40:26.705709 30006 tablet_replica.cc:439] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } }
I20260810 06:40:26.705785 30006 tablet_replica.cc:442] T 82966cab095742248b30043ab58c6403 P bb8f0cdd063b4ef7b423dd14afe2e4f3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:26.706625 30011 tablet_replica.cc:439] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } }
I20260810 06:40:26.706703 30011 tablet_replica.cc:442] T 82966cab095742248b30043ab58c6403 P 4fc516aaed074d3a9c19f8c7678f2a61: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:40:26.707021 30017 mvcc.cc:205] Tried to move back new op lower bound from 7316865133376102400 to 7316865133325606912. Current Snapshot: MvccSnapshot[applied={T|T < 7316865133376102400}]
I20260810 06:40:26.707129 30007 tablet_replica.cc:439] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 } } peers { permanent_uuid: "1d849e025ad446e2bed896dbc32d5a81" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 38745 } } peers { permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 } } }
I20260810 06:40:26.707195 30007 tablet_replica.cc:442] T 82966cab095742248b30043ab58c6403 P 1d849e025ad446e2bed896dbc32d5a81: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:26.709939 29993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.707487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60462 (local address 127.27.41.130:38745)
0810 06:40:26.707553 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.707555 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.707564 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:26.707595 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.707596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.707614 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.707679 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:26.707842 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.708286 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.709115 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.709371 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.709429 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.709603 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:26.709710 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:26.709782 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.709829 (+ 47us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.709853 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 06:40:26.714852 29805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.712243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:37783 (local address 127.27.41.130:38853)
0810 06:40:26.712311 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.712321 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.712365 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.712489 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.712490 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.712491 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:40:26.712573 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.712574 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.713452 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.713453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.714020 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.714021 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.714488 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.714489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.714540 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.714554 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:40:26.714722 (+ 168us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:40:26.714736 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.714771 (+ 35us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.714807 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 06:40:26.714857 29996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.712311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:38853 (local address 127.27.41.129:37783)
0810 06:40:26.712347 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.712349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.712358 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:26.712410 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.712410 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.712421 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.712488 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:26.712630 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.713295 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.714099 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.714390 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.714461 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.714630 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:26.714662 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:26.714717 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.714773 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.714794 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 06:40:26.717105 29917 raft_consensus.cc:1261] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 1 FOLLOWER]: Refusing update from remote peer 1d849e025ad446e2bed896dbc32d5a81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:26.717118 29543 raft_consensus.cc:1261] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61 [term 1 FOLLOWER]: Refusing update from remote peer 1d849e025ad446e2bed896dbc32d5a81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:26.717320 30007 consensus_queue.cc:1035] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8f0cdd063b4ef7b423dd14afe2e4f3" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:26.717455 30036 consensus_queue.cc:1035] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fc516aaed074d3a9c19f8c7678f2a61" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:26.722152 30016 mvcc.cc:205] Tried to move back new op lower bound from 7316865133431492608 to 7316865132943626240. Current Snapshot: MvccSnapshot[applied={T|T < 7316865133431492608}]
I20260810 06:40:26.728505 29993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.726132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:39913 (local address 127.27.41.130:38745)
0810 06:40:26.726170 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.726172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.726180 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:40:26.726241 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.726242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.726250 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.726289 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:26.726402 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.726828 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.727911 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.728107 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.728159 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.728333 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:26.728358 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:26.728394 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.728445 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.728463 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 06:40:26.728559 30067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.725949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:38745 (local address 127.27.41.129:39913)
0810 06:40:26.726122 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:26.726133 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:26.726188 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:26.726302 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:26.726303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:26.726304 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:40:26.726347 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.726348 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.726893 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.726894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.727800 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:26.727803 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.728175 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.728176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:26.728235 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.728252 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:40:26.728396 (+ 144us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:40:26.728397 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 06:40:26.728444 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 06:40:26.728485 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":100,"threads_started":1}
I20260810 06:40:26.737994 29332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:26.738104 29332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:26.738686 29332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b8720616b9f1492f969ace8dddc1c24d: Sending DeleteTablet for 3 replicas of tablet 6a2871eba5a9475ebebfb590e18f27ea
I20260810 06:40:26.738956 29714 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a2871eba5a9475ebebfb590e18f27ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:26 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:60446
I20260810 06:40:26.739017 29894 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a2871eba5a9475ebebfb590e18f27ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:26 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:41962
I20260810 06:40:26.739048 30028 tablet_replica.cc:330] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81: stopping tablet replica
I20260810 06:40:26.739096 30031 tablet_replica.cc:330] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3: stopping tablet replica
I20260810 06:40:26.739097 30028 raft_consensus.cc:2229] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:40:26.739136 30031 raft_consensus.cc:2229] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:26.739171 30031 raft_consensus.cc:2258] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:26.739178 30028 raft_consensus.cc:2258] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:26.739503 30031 ts_tablet_manager.cc:1905] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:26.739624 30028 ts_tablet_manager.cc:1905] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:26.741293 29519 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a2871eba5a9475ebebfb590e18f27ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:26 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:48654
I20260810 06:40:26.741405 30029 tablet_replica.cc:330] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61: stopping tablet replica
I20260810 06:40:26.741453 30029 raft_consensus.cc:2229] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:26.741484 30029 raft_consensus.cc:2258] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:26.741685 30031 ts_tablet_manager.cc:1918] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:26.741744 30031 log.cc:1196] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/6a2871eba5a9475ebebfb590e18f27ea
I20260810 06:40:26.741994 30031 ts_tablet_manager.cc:1939] T 6a2871eba5a9475ebebfb590e18f27ea P bb8f0cdd063b4ef7b423dd14afe2e4f3: Deleting consensus metadata
I20260810 06:40:26.742156 30029 ts_tablet_manager.cc:1905] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:26.742311 29310 catalog_manager.cc:4841] TS bb8f0cdd063b4ef7b423dd14afe2e4f3 (127.27.41.131:45135): tablet 6a2871eba5a9475ebebfb590e18f27ea (table test-table [id=b9806763d7374e269dd4cc9734035084]) successfully deleted
I20260810 06:40:26.743887 30029 ts_tablet_manager.cc:1918] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:26.743947 30029 log.cc:1196] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-0/wal/wals/6a2871eba5a9475ebebfb590e18f27ea
I20260810 06:40:26.744155 30029 ts_tablet_manager.cc:1939] T 6a2871eba5a9475ebebfb590e18f27ea P 4fc516aaed074d3a9c19f8c7678f2a61: Deleting consensus metadata
I20260810 06:40:26.744575 29315 catalog_manager.cc:4841] TS 4fc516aaed074d3a9c19f8c7678f2a61 (127.27.41.129:37783): tablet 6a2871eba5a9475ebebfb590e18f27ea (table test-table [id=b9806763d7374e269dd4cc9734035084]) successfully deleted
I20260810 06:40:26.744757 30028 ts_tablet_manager.cc:1918] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:26.744812 30028 log.cc:1196] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/6a2871eba5a9475ebebfb590e18f27ea
I20260810 06:40:26.745028 30028 ts_tablet_manager.cc:1939] T 6a2871eba5a9475ebebfb590e18f27ea P 1d849e025ad446e2bed896dbc32d5a81: Deleting consensus metadata
I20260810 06:40:26.745390 29314 catalog_manager.cc:4841] TS 1d849e025ad446e2bed896dbc32d5a81 (127.27.41.130:38745): tablet 6a2871eba5a9475ebebfb590e18f27ea (table test-table [id=b9806763d7374e269dd4cc9734035084]) successfully deleted
Aug 10 06:40:26 dist-test-slave-bw88 krb5kdc[29265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344026, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.41.129@KRBTEST.COM
I20260810 06:40:26.751554 29996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.742679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48690 (local address 127.27.41.129:37783)
0810 06:40:26.742716 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.742718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.742978 (+ 260us) server_negotiation.cc:407] Connection header received
0810 06:40:26.743083 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.743084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.743095 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.743126 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:26.743899 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.744636 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.745711 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.745925 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.746015 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.748795 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:26.748804 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:26.748804 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:26.748811 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:26.750420 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.750782 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.750785 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.750786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.750845 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.751038 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.751039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.751039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.751173 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:26.751344 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.751381 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.751460 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 06:40:26.751854 29599 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48690
I20260810 06:40:26.767357 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:26.752702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55290 (local address 127.27.41.190:45291)
0810 06:40:26.752749 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:26.752752 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:26.761534 (+ 8782us) server_negotiation.cc:407] Connection header received
0810 06:40:26.761614 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:26.761615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:26.761628 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:26.761694 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:26.762220 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.762730 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.763389 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:26.763598 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:26.763668 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:26.764812 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:26.764813 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:26.764814 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:26.764821 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:26.766241 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.766589 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.766591 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.766591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.766646 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:26.766838 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:26.766839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:26.766839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:26.766950 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:26.767049 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:26.767170 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 06:40:26.767247 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260810 06:40:26.767668 29332 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55290
I20260810 06:40:26.768355 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 29427
I20260810 06:40:26.784668 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 29622
I20260810 06:40:26.795795 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 29809
I20260810 06:40:26.807047 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 29289
2026-08-10T06:40:26Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2362 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:26 dist-test-slave-bw88 krb5kdc[30077](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:26 dist-test-slave-bw88 krb5kdc[30077](info): set up 2 sockets
Aug 10 06:40:26 dist-test-slave-bw88 krb5kdc[30077](info): commencing operation
krb5kdc: starting...
W20260810 06:40:28.023759 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:28 dist-test-slave-bw88 krb5kdc[30077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:40:28.148464 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:45329
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:45329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:28.229540 30100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:28.229734 30100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:28.229755 30100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:28.230893 30100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:28.230935 30100 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 06:40:28.230949 30100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:28.230999 30100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:28.231032 30100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:28.231079 30100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:28.232654 30100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:45329
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:45329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:28.232894 30100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:28.233126 30100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:28.238343 30108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:28.238328 30112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:28.238327 30109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:28.238631 30100 server_base.cc:1034] running on GCE node
I20260810 06:40:28.238873 30100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:28.239154 30100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:28.240335 30100 hybrid_clock.cc:648] HybridClock initialized: now 1786344028240324 us; error 32 us; skew 500 ppm
Aug 10 06:40:28 dist-test-slave-bw88 krb5kdc[30077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344028, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:28.242873 30100 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:40:28.243372 30100 webserver.cc:460] Webserver started at http://127.27.41.190:43363/ using document root <none> and password file <none>
I20260810 06:40:28.243597 30100 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:28.243664 30100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:28.243798 30100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:28.244832 30100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "5bbcc670e07e49ec849b7a178f8e0514"
format_stamp: "Formatted at 2026-08-10 06:40:28 on dist-test-slave-bw88"
server_key: "2504db0466d4c67b3683650216157e95"
server_key_iv: "fe49cae310850842413b9baa4356e411"
server_key_version: "encryptionkey@0"
I20260810 06:40:28.245224 30100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "5bbcc670e07e49ec849b7a178f8e0514"
format_stamp: "Formatted at 2026-08-10 06:40:28 on dist-test-slave-bw88"
server_key: "2504db0466d4c67b3683650216157e95"
server_key_iv: "fe49cae310850842413b9baa4356e411"
server_key_version: "encryptionkey@0"
I20260810 06:40:28.246564 30100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:28.247238 30120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:28.247449 30100 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:28.247558 30100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "5bbcc670e07e49ec849b7a178f8e0514"
format_stamp: "Formatted at 2026-08-10 06:40:28 on dist-test-slave-bw88"
server_key: "2504db0466d4c67b3683650216157e95"
server_key_iv: "fe49cae310850842413b9baa4356e411"
server_key_version: "encryptionkey@0"
I20260810 06:40:28.247632 30100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:28.270694 30100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:28.273074 30100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:28.273249 30100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:28.278136 30100 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:45329
I20260810 06:40:28.278200 30199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:45329 every 8 connection(s)
I20260810 06:40:28.278523 30100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:28.279214 30200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:28.281611 30200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514: Bootstrap starting.
I20260810 06:40:28.282195 30200 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:28.282435 30200 log.cc:824] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:28.283126 30200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514: No bootstrap required, opened a new log
I20260810 06:40:28.283993 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 30100
I20260810 06:40:28.284118 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:28.284281 27814 external_mini_cluster.cc:1428] Setting key 0f2ef12e4cfeec511ca94f283c3f54bf
I20260810 06:40:28.285158 30200 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bbcc670e07e49ec849b7a178f8e0514" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45329 } }
I20260810 06:40:28.285385 30200 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:28.285439 30200 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bbcc670e07e49ec849b7a178f8e0514, State: Initialized, Role: FOLLOWER
I20260810 06:40:28.285583 30200 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bbcc670e07e49ec849b7a178f8e0514" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45329 } }
I20260810 06:40:28.285665 30200 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:28.285707 30200 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:28.285799 30200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:28.286605 30200 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bbcc670e07e49ec849b7a178f8e0514" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45329 } }
I20260810 06:40:28.286702 30200 leader_election.cc:302] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5bbcc670e07e49ec849b7a178f8e0514; no voters:
I20260810 06:40:28.286883 30200 leader_election.cc:288] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:28.286933 30207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:28.287119 30207 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [term 1 LEADER]: Becoming Leader. State: Replica: 5bbcc670e07e49ec849b7a178f8e0514, State: Running, Role: LEADER
I20260810 06:40:28.287182 30200 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:28.287263 30207 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bbcc670e07e49ec849b7a178f8e0514" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45329 } }
I20260810 06:40:28.287703 30207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5bbcc670e07e49ec849b7a178f8e0514. Latest consensus state: current_term: 1 leader_uuid: "5bbcc670e07e49ec849b7a178f8e0514" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bbcc670e07e49ec849b7a178f8e0514" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45329 } } }
I20260810 06:40:28.287725 30209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5bbcc670e07e49ec849b7a178f8e0514" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bbcc670e07e49ec849b7a178f8e0514" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45329 } } }
I20260810 06:40:28.287846 30209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:28.288077 30207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:28.288259 30220 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:28.288786 30220 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:28.290570 30220 catalog_manager.cc:1347] Generated new cluster ID: c03788d6811041f994cc630e188f8acb
I20260810 06:40:28.290627 30220 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:40:28 dist-test-slave-bw88 krb5kdc[30077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:28.296595 30204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.285092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47914 (local address 127.27.41.190:45329)
0810 06:40:28.285288 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.285296 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.285321 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:40:28.285522 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.285542 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.285597 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.285744 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:28.286544 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.287890 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.289004 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.289675 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.289801 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.292653 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:28.292657 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:28.292658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:28.292670 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:28.294900 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.295276 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.295280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.295280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.295447 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.295663 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.295664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.295664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.295996 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:28.296147 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.296258 (+ 111us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.296400 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":103,"threads_started":1}
I20260810 06:40:28.307255 30220 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:28.307963 30220 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:28.323565 30220 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514: Generated new TSK 0
I20260810 06:40:28.323786 30220 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:40:28.364352 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:45329
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:28.447372 30236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:28.447610 30236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:28.447656 30236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:28.448807 30236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:28.448872 30236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:28.448908 30236 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 06:40:28.448956 30236 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:40:28.448990 30236 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:28.450665 30236 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.41.190:45329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:28.450938 30236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:28.451184 30236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:28.456578 30242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:28.456651 30241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:28.456578 30250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:28.456789 30236 server_base.cc:1034] running on GCE node
I20260810 06:40:28.457010 30236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:28.457222 30236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:28.458423 30236 hybrid_clock.cc:648] HybridClock initialized: now 1786344028458401 us; error 32 us; skew 500 ppm
Aug 10 06:40:28 dist-test-slave-bw88 krb5kdc[30077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344028, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:28.461203 30236 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:40:28.461760 30236 webserver.cc:460] Webserver started at http://127.27.41.129:43465/ using document root <none> and password file <none>
I20260810 06:40:28.462039 30236 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:28.462116 30236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:28.462282 30236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:28.463425 30236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "d9e6f52602a041e183511fcd196dcc09"
format_stamp: "Formatted at 2026-08-10 06:40:28 on dist-test-slave-bw88"
server_key: "8f59a765c868111b8ed85bb21d87bdf1"
server_key_iv: "0e7cd6eab55a904a8811440893b91a3f"
server_key_version: "encryptionkey@0"
I20260810 06:40:28.463806 30236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "d9e6f52602a041e183511fcd196dcc09"
format_stamp: "Formatted at 2026-08-10 06:40:28 on dist-test-slave-bw88"
server_key: "8f59a765c868111b8ed85bb21d87bdf1"
server_key_iv: "0e7cd6eab55a904a8811440893b91a3f"
server_key_version: "encryptionkey@0"
I20260810 06:40:28.465456 30236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:40:28.466266 30257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:28.466436 30236 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:28.466544 30236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "d9e6f52602a041e183511fcd196dcc09"
format_stamp: "Formatted at 2026-08-10 06:40:28 on dist-test-slave-bw88"
server_key: "8f59a765c868111b8ed85bb21d87bdf1"
server_key_iv: "0e7cd6eab55a904a8811440893b91a3f"
server_key_version: "encryptionkey@0"
I20260810 06:40:28.466619 30236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:28.493448 30236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:28.495443 30236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:28.495618 30236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:28.496212 30236 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:28.496272 30236 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:28.496313 30236 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:28.496341 30236 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:28.503479 30236 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:33631
I20260810 06:40:28.503542 30420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:33631 every 8 connection(s)
I20260810 06:40:28.503849 30236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
Aug 10 06:40:28 dist-test-slave-bw88 krb5kdc[30077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344028, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:28.510198 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 30236
I20260810 06:40:28.510318 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:40:28.510509 27814 external_mini_cluster.cc:1428] Setting key a5738d4fe2423b31a4f2719837ad97db
I20260810 06:40:28.511075 30204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.496683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:37539 (local address 127.27.41.190:45329)
0810 06:40:28.496756 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.496759 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.496962 (+ 203us) server_negotiation.cc:407] Connection header received
0810 06:40:28.497519 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.497521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.497548 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.497630 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:28.498256 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.499085 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.500237 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.500464 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.500540 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.508212 (+ 7672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:28.508214 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:28.508215 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:28.508231 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:28.509518 (+ 1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.509945 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.509946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.509947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.510011 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.510293 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.510294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.510294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.510462 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:28.510540 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.510886 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.510982 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 06:40:28.511266 30269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.496652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45329 (local address 127.27.41.129:37539)
0810 06:40:28.496826 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:28.496865 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:28.497417 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:28.497705 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:28.497708 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:28.497942 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:28.498151 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.498155 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.499179 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.499180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.500135 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.500138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.500552 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.500554 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.500748 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.506732 (+ 5984us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:28.506741 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:28.508105 (+ 1364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:28.509601 (+ 1496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.509610 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.509612 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.509850 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.510105 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.510106 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.510106 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.510217 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.510544 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:28.510552 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:28.510746 (+ 194us) client_negotiation.cc:769] Sending connection context
0810 06:40:28.510859 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 06:40:28.511030 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":101,"threads_started":1}
I20260810 06:40:28.511812 30421 heartbeater.cc:347] Connected to a master server at 127.27.41.190:45329
I20260810 06:40:28.511929 30421 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:28.512117 30421 heartbeater.cc:511] Master 127.27.41.190:45329 requested a full tablet report, sending...
I20260810 06:40:28.512686 30137 ts_manager.cc:194] Registered new tserver with Master: d9e6f52602a041e183511fcd196dcc09 (127.27.41.129:33631)
I20260810 06:40:28.513496 30137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:37539
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
I20260810 06:40:28.519516 30429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.513860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45329 (local address 127.27.41.129:58631)
0810 06:40:28.514004 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:28.514014 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:28.514083 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:28.514230 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:28.514231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:28.514432 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:28.514501 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.514503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.515149 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.515150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.515716 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.515719 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.516089 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.516090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.516183 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.516626 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:28.516632 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:28.516910 (+ 278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:28.518474 (+ 1564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.518475 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.518476 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.518656 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.518873 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.518874 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.518874 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.518936 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.519186 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:28.519187 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:28.519233 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 06:40:28.519321 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 06:40:28.519426 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":79,"threads_started":1}
I20260810 06:40:28.519510 30204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.513937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:58631 (local address 127.27.41.190:45329)
0810 06:40:28.513980 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.513981 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.514094 (+ 113us) server_negotiation.cc:407] Connection header received
0810 06:40:28.514152 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.514153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.514165 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.514218 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:28.514595 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.515058 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.515795 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.516001 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.516078 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.517020 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:28.517021 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:28.517021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:28.517028 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:28.518375 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.518745 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.518746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.518747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.518807 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.519006 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.519007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.519008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.519118 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:28.519193 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.519346 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.519424 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:40:28.535916 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:45329
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:28.618855 30431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:28.619092 30431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:28.619143 30431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:28.620292 30431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:28.620357 30431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:28.620390 30431 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 06:40:28.620420 30431 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:40:28.620452 30431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:28.621974 30431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.41.190:45329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:28.622243 30431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:28.622468 30431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:28.627658 30440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:28.627617 30437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:28.627642 30438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:28.627769 30431 server_base.cc:1034] running on GCE node
I20260810 06:40:28.628084 30431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:28.628381 30431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:28.629542 30431 hybrid_clock.cc:648] HybridClock initialized: now 1786344028629529 us; error 26 us; skew 500 ppm
Aug 10 06:40:28 dist-test-slave-bw88 krb5kdc[30077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344028, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:28.631959 30431 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:40:28.632375 30431 webserver.cc:460] Webserver started at http://127.27.41.130:37731/ using document root <none> and password file <none>
I20260810 06:40:28.632624 30431 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:28.632696 30431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:28.632844 30431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:28.633955 30431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "9bc681e3fd7e4c3da9b699d79408c6fa"
format_stamp: "Formatted at 2026-08-10 06:40:28 on dist-test-slave-bw88"
server_key: "dc3fd0c73ac3950b43c531e444b7385a"
server_key_iv: "2087b4addf7501c6c791bcb60fb7830d"
server_key_version: "encryptionkey@0"
I20260810 06:40:28.634325 30431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "9bc681e3fd7e4c3da9b699d79408c6fa"
format_stamp: "Formatted at 2026-08-10 06:40:28 on dist-test-slave-bw88"
server_key: "dc3fd0c73ac3950b43c531e444b7385a"
server_key_iv: "2087b4addf7501c6c791bcb60fb7830d"
server_key_version: "encryptionkey@0"
I20260810 06:40:28.635771 30431 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:40:28.636500 30450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:28.636680 30431 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:28.636790 30431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "9bc681e3fd7e4c3da9b699d79408c6fa"
format_stamp: "Formatted at 2026-08-10 06:40:28 on dist-test-slave-bw88"
server_key: "dc3fd0c73ac3950b43c531e444b7385a"
server_key_iv: "2087b4addf7501c6c791bcb60fb7830d"
server_key_version: "encryptionkey@0"
I20260810 06:40:28.636864 30431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:28.645576 30431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:28.647416 30431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:28.647581 30431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:28.648097 30431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:28.648156 30431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:28.648200 30431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:28.648224 30431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 06:40:28 dist-test-slave-bw88 krb5kdc[30077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344028, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:28.655987 30431 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:40991
I20260810 06:40:28.656072 30614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:40991 every 8 connection(s)
I20260810 06:40:28.656355 30431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:40:28.659428 30204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.648701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:42027 (local address 127.27.41.190:45329)
0810 06:40:28.648778 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.648781 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.649016 (+ 235us) server_negotiation.cc:407] Connection header received
0810 06:40:28.649790 (+ 774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.649791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.649817 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.649896 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:28.650641 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.651488 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.653214 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.653565 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.653646 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.656398 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:28.656400 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:28.656400 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:28.656409 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:28.657998 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.658432 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.658433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.658434 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.658506 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.658761 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.658762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.658762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.658887 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:28.658970 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.659251 (+ 281us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.659337 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 06:40:28.659601 30463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.648668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45329 (local address 127.27.41.130:42027)
0810 06:40:28.648866 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:28.648915 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:28.649664 (+ 749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:28.650020 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:28.650025 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:28.650280 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:28.650548 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.650553 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.651628 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.651629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.653092 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.653096 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.653695 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.653696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.653861 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.654357 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:28.654368 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:28.656300 (+ 1932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:28.658109 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.658118 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.658120 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.658344 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.658575 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.658576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.658577 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.658692 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.658961 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:28.658968 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:28.659113 (+ 145us) client_negotiation.cc:769] Sending connection context
0810 06:40:28.659215 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 06:40:28.659374 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":103,"threads_started":1}
I20260810 06:40:28.660107 30615 heartbeater.cc:347] Connected to a master server at 127.27.41.190:45329
I20260810 06:40:28.660192 30615 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:28.660379 30615 heartbeater.cc:511] Master 127.27.41.190:45329 requested a full tablet report, sending...
I20260810 06:40:28.660637 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 30431
I20260810 06:40:28.660740 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:40:28.660768 30138 ts_manager.cc:194] Registered new tserver with Master: 9bc681e3fd7e4c3da9b699d79408c6fa (127.27.41.130:40991)
I20260810 06:40:28.660925 27814 external_mini_cluster.cc:1428] Setting key f615faed10e9bf2169ef1bce6e9d1270
I20260810 06:40:28.661284 30138 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:42027
I20260810 06:40:28.667580 30625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.661208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45329 (local address 127.27.41.130:48685)
0810 06:40:28.661377 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:28.661387 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:28.661486 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:28.661693 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:28.661694 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:28.661920 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:28.661991 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.662003 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.662694 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.662695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.663529 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.663532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.664009 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.664010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.664069 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.664499 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:28.664505 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:28.664787 (+ 282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:28.666561 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.666562 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.666562 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.666724 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.666937 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.666938 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.666938 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.666991 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.667350 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:28.667350 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:28.667387 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 06:40:28.667436 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 06:40:28.667517 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
I20260810 06:40:28.667691 30204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.661416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:48685 (local address 127.27.41.190:45329)
0810 06:40:28.661452 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.661454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.661461 (+ 7us) server_negotiation.cc:407] Connection header received
0810 06:40:28.661577 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.661578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.661588 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.661634 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:28.662094 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.662592 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.663623 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.663918 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.663992 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.664878 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:28.664879 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:28.664880 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:28.664887 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:28.666474 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.666801 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.666803 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.666803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.666866 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.667067 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.667068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.667069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.667280 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:28.667362 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.667467 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.667560 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:40:28.687888 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:45329
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:28.771189 30628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:28.771394 30628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:28.771420 30628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:28.772554 30628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:28.772603 30628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:28.772624 30628 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 06:40:28.772636 30628 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:40:28.772691 30628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:28.774180 30628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.41.190:45329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:28.774463 30628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:28.774693 30628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:28.779933 30642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:28.779933 30636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:28.779968 30638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:28.780404 30628 server_base.cc:1034] running on GCE node
I20260810 06:40:28.780624 30628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:28.780862 30628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:28.782025 30628 hybrid_clock.cc:648] HybridClock initialized: now 1786344028782009 us; error 28 us; skew 500 ppm
Aug 10 06:40:28 dist-test-slave-bw88 krb5kdc[30077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344028, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:28.789088 30628 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:40:28.789577 30628 webserver.cc:460] Webserver started at http://127.27.41.131:38449/ using document root <none> and password file <none>
I20260810 06:40:28.789824 30628 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:28.789894 30628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:28.790052 30628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:28.791105 30628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "29acc47bef004e0facc6ee177ca10033"
format_stamp: "Formatted at 2026-08-10 06:40:28 on dist-test-slave-bw88"
server_key: "fc45fc6b3736db8b09882dbb051812f1"
server_key_iv: "0e95d915cc9d58aae31baa2d2e8ac3f4"
server_key_version: "encryptionkey@0"
I20260810 06:40:28.791473 30628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "29acc47bef004e0facc6ee177ca10033"
format_stamp: "Formatted at 2026-08-10 06:40:28 on dist-test-slave-bw88"
server_key: "fc45fc6b3736db8b09882dbb051812f1"
server_key_iv: "0e95d915cc9d58aae31baa2d2e8ac3f4"
server_key_version: "encryptionkey@0"
I20260810 06:40:28.792866 30628 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:40:28.793619 30652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:28.793787 30628 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:28.793896 30628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "29acc47bef004e0facc6ee177ca10033"
format_stamp: "Formatted at 2026-08-10 06:40:28 on dist-test-slave-bw88"
server_key: "fc45fc6b3736db8b09882dbb051812f1"
server_key_iv: "0e95d915cc9d58aae31baa2d2e8ac3f4"
server_key_version: "encryptionkey@0"
I20260810 06:40:28.793972 30628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:28.816521 30628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:28.819944 30628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:28.820113 30628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:28.820742 30628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:28.820806 30628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:28.820845 30628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:28.820873 30628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 06:40:28 dist-test-slave-bw88 krb5kdc[30077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344028, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:28.830763 30628 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:38251
I20260810 06:40:28.830847 30813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:38251 every 8 connection(s)
I20260810 06:40:28.831202 30628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:40:28.832450 30204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.821515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:38665 (local address 127.27.41.190:45329)
0810 06:40:28.821582 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.821584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.821599 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:40:28.822357 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.822358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.822373 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.822428 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:28.823343 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.824159 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.825840 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.826165 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.826233 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.828972 (+ 2739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:28.828974 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:28.828974 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:28.828982 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:28.830764 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.831298 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.831299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.831300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.831364 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.831693 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.831694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.831694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.831834 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:28.831901 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.832267 (+ 366us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.832359 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 06:40:28.832639 30669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.821098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45329 (local address 127.27.41.131:38665)
0810 06:40:28.821301 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:28.821373 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:28.822235 (+ 862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:28.822500 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:28.822505 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:28.822917 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:28.823233 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.823241 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.824267 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.824268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.825727 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.825731 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.826318 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.826319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.826483 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.827103 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:28.827114 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:28.828856 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:28.830862 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.830868 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.830870 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.831200 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.831437 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.831438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.831438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.831596 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.831896 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:28.831908 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:28.832095 (+ 187us) client_negotiation.cc:769] Sending connection context
0810 06:40:28.832228 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 06:40:28.832387 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":118,"threads_started":1}
I20260810 06:40:28.833024 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 30628
I20260810 06:40:28.833114 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:40:28.833184 30814 heartbeater.cc:347] Connected to a master server at 127.27.41.190:45329
I20260810 06:40:28.833258 30814 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:28.833388 27814 external_mini_cluster.cc:1428] Setting key d66fd6411d1cf1a123a207912f3238db
I20260810 06:40:28.833460 30814 heartbeater.cc:511] Master 127.27.41.190:45329 requested a full tablet report, sending...
I20260810 06:40:28.834012 30138 ts_manager.cc:194] Registered new tserver with Master: 29acc47bef004e0facc6ee177ca10033 (127.27.41.131:38251)
I20260810 06:40:28.834471 30138 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:38665
I20260810 06:40:28.834482 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:40:28.845359 30204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.834361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:42617 (local address 127.27.41.190:45329)
0810 06:40:28.834400 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.834401 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.837475 (+ 3074us) server_negotiation.cc:407] Connection header received
0810 06:40:28.837528 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.837529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.837541 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.837608 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:28.838049 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.838853 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.840941 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.841130 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.841233 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.842367 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:28.842369 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:28.842369 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:28.842376 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:28.844017 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.844458 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.844459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.844460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.844530 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.844748 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.844749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.844749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.844890 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:28.844963 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.845156 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.845239 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:40:28.845383 30824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.837215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45329 (local address 127.27.41.131:42617)
0810 06:40:28.837378 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:28.837389 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:28.837453 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:28.837637 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:28.837638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:28.837887 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:28.837958 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.837960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.838951 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.838953 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.839651 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.839653 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.841251 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.841252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.841369 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.841829 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:28.841834 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:28.842262 (+ 428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:28.844118 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.844119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.844120 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.844373 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.844608 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.844609 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.844610 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.844677 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.844964 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:28.844965 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:28.845019 (+ 54us) client_negotiation.cc:769] Sending connection context
0810 06:40:28.845106 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 06:40:28.845214 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":81,"threads_started":1}
Aug 10 06:40:28 dist-test-slave-bw88 krb5kdc[30077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 06:40:28 dist-test-slave-bw88 krb5kdc[30077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:28.868244 30204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.860344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47930 (local address 127.27.41.190:45329)
0810 06:40:28.860390 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.860392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.860401 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:28.860435 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.860436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.860446 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.860510 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:28.861129 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.861749 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.862517 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.862725 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.862801 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.865218 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:28.865219 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:28.865220 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:28.865227 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:28.866781 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.867187 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.867189 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.867189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.867254 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.867537 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.867538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.867538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.867673 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:28.867773 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.867989 (+ 216us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.868101 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 06:40:28.870067 30138 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:40:28.872589 30138 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:28.880311 30841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.875221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:40991 (local address 127.0.0.1:59806)
0810 06:40:28.875610 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:28.875651 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:28.875722 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:28.876669 (+ 947us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:28.876681 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:28.876684 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:28.876747 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.876749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.878002 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.878003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.879019 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.879022 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.880000 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.880001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.880084 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.880100 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 06:40:28.880160 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 06:40:28.880217 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":64,"threads_started":1}
I20260810 06:40:28.880553 30844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.875727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59806 (local address 127.27.41.130:40991)
0810 06:40:28.876507 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.876511 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.876521 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:40:28.876573 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.876575 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.876589 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.876668 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:28.876844 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.877929 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.879114 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.879911 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.879997 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.880366 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.880397 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.880446 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":742,"thread_start_us":92,"threads_started":1}
I20260810 06:40:28.880722 30845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.875932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32874 (local address 127.27.41.131:38251)
0810 06:40:28.876129 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.876133 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.876140 (+ 7us) server_negotiation.cc:407] Connection header received
0810 06:40:28.876174 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.876175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.876187 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.876279 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:28.876459 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.877639 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.879420 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.880173 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.880242 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.880295 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.880559 (+ 264us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.880599 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":81,"threads_started":1}
I20260810 06:40:28.881482 30840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.875237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:38251 (local address 127.0.0.1:32874)
0810 06:40:28.875829 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:28.875838 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:28.875942 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:28.876291 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:28.876295 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:28.876297 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:28.876367 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.876369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.877736 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.877737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.879319 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.879323 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.880329 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.880330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.880384 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.880388 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:28.880442 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 06:40:28.881399 (+ 957us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"mutex_wait_us":25,"thread_start_us":94,"threads_started":1}
I20260810 06:40:28.881443 30523 tablet_service.cc:1467] Processing CreateTablet for tablet caed7719c91441698372ae182c8fd8bb (DEFAULT_TABLE table=test-table [id=224907c86ee146879faf15902626fce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:28.881888 30523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caed7719c91441698372ae182c8fd8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:28.882251 30726 tablet_service.cc:1467] Processing CreateTablet for tablet caed7719c91441698372ae182c8fd8bb (DEFAULT_TABLE table=test-table [id=224907c86ee146879faf15902626fce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:28.882637 30726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caed7719c91441698372ae182c8fd8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:28.883033 30839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.875237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:33631 (local address 127.0.0.1:52702)
0810 06:40:28.876745 (+ 1508us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:28.876755 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:28.876809 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:28.878178 (+ 1369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:28.878179 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:28.878182 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:28.878256 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.878258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.879564 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.879565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.881269 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.881272 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.882814 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.882815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.882874 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.882877 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:28.882929 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 06:40:28.882967 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1493,"mutex_wait_us":4,"thread_start_us":96,"threads_started":1}
I20260810 06:40:28.883329 30843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.875495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52702 (local address 127.27.41.129:33631)
0810 06:40:28.876416 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.876420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.876809 (+ 389us) server_negotiation.cc:407] Connection header received
0810 06:40:28.878049 (+ 1240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.878065 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.878084 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.878165 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:28.878368 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.879467 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.881884 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.882628 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.882701 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.882755 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.883182 (+ 427us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.883228 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":877,"thread_start_us":103,"threads_started":1}
I20260810 06:40:28.883934 30330 tablet_service.cc:1467] Processing CreateTablet for tablet caed7719c91441698372ae182c8fd8bb (DEFAULT_TABLE table=test-table [id=224907c86ee146879faf15902626fce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:28.884271 30330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caed7719c91441698372ae182c8fd8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:28.885933 30848 tablet_bootstrap.cc:492] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa: Bootstrap starting.
I20260810 06:40:28.886377 30849 tablet_bootstrap.cc:492] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033: Bootstrap starting.
I20260810 06:40:28.886669 30848 tablet_bootstrap.cc:654] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:28.887070 30848 log.cc:824] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:28.887439 30849 tablet_bootstrap.cc:654] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:28.887811 30849 log.cc:824] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:28.888106 30848 tablet_bootstrap.cc:492] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa: No bootstrap required, opened a new log
I20260810 06:40:28.888185 30848 ts_tablet_manager.cc:1397] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:40:28.888715 30849 tablet_bootstrap.cc:492] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033: No bootstrap required, opened a new log
I20260810 06:40:28.888813 30849 ts_tablet_manager.cc:1397] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:40:28.889462 30853 tablet_bootstrap.cc:492] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09: Bootstrap starting.
I20260810 06:40:28.890014 30848 raft_consensus.cc:348] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.890154 30853 tablet_bootstrap.cc:654] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:28.890198 30848 raft_consensus.cc:374] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:28.890249 30848 raft_consensus.cc:729] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc681e3fd7e4c3da9b699d79408c6fa, State: Initialized, Role: FOLLOWER
I20260810 06:40:28.890370 30848 consensus_queue.cc:260] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.890491 30853 log.cc:824] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:28.890668 30848 ts_tablet_manager.cc:1428] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 06:40:28.890839 30615 heartbeater.cc:503] Master 127.27.41.190:45329 was elected leader, sending a full tablet report...
I20260810 06:40:28.890911 30849 raft_consensus.cc:348] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.891076 30849 raft_consensus.cc:374] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:28.891125 30849 raft_consensus.cc:729] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29acc47bef004e0facc6ee177ca10033, State: Initialized, Role: FOLLOWER
I20260810 06:40:28.891286 30849 consensus_queue.cc:260] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.891605 30814 heartbeater.cc:503] Master 127.27.41.190:45329 was elected leader, sending a full tablet report...
I20260810 06:40:28.891817 30849 ts_tablet_manager.cc:1428] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:40:28.892217 30853 tablet_bootstrap.cc:492] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09: No bootstrap required, opened a new log
I20260810 06:40:28.892290 30853 ts_tablet_manager.cc:1397] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 06:40:28.894011 30853 raft_consensus.cc:348] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.894155 30853 raft_consensus.cc:374] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:28.894197 30853 raft_consensus.cc:729] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9e6f52602a041e183511fcd196dcc09, State: Initialized, Role: FOLLOWER
I20260810 06:40:28.894338 30853 consensus_queue.cc:260] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.895383 30853 ts_tablet_manager.cc:1428] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:40:28.895468 30421 heartbeater.cc:503] Master 127.27.41.190:45329 was elected leader, sending a full tablet report...
W20260810 06:40:28.907296 30617 tablet.cc:2369] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:40:28.916695 30856 raft_consensus.cc:482] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:28.916843 30856 raft_consensus.cc:504] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.917276 30856 leader_election.cc:288] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc681e3fd7e4c3da9b699d79408c6fa (127.27.41.130:40991), d9e6f52602a041e183511fcd196dcc09 (127.27.41.129:33631)
I20260810 06:40:28.921221 30843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.917573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:58935 (local address 127.27.41.129:33631)
0810 06:40:28.917620 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.917622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.917751 (+ 129us) server_negotiation.cc:407] Connection header received
0810 06:40:28.917847 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.917848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.917857 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.917887 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:28.918100 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.918765 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.920385 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.920862 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.920902 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.920909 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.921102 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.921157 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 06:40:28.921232 30858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.917501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:33631 (local address 127.27.41.131:58935)
0810 06:40:28.917693 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:28.917705 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:28.917775 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:28.917955 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:28.917956 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:28.917957 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:28.918030 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.918032 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.918848 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.918849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.920276 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.920280 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.920961 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.920962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.921022 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.921025 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:28.921095 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 06:40:28.921132 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":59,"thread_start_us":90,"threads_started":1}
I20260810 06:40:28.921463 30669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.917416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:40991 (local address 127.27.41.131:43717)
0810 06:40:28.917477 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:28.917492 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:28.917545 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:28.917763 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:28.917763 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:28.917765 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:28.917863 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.917865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.918848 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.918849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.920274 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.920277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.921155 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.921156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.921245 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.921247 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:40:28.921315 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 06:40:28.921380 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":38}
I20260810 06:40:28.921790 30844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.917600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:43717 (local address 127.27.41.130:40991)
0810 06:40:28.917644 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.917645 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.917653 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:40:28.917683 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.917684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.917693 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.917759 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:28.917940 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.918669 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.920380 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.921044 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.921132 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.921152 (+ 20us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.921680 (+ 528us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.921725 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 06:40:28.921841 30354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caed7719c91441698372ae182c8fd8bb" candidate_uuid: "29acc47bef004e0facc6ee177ca10033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e6f52602a041e183511fcd196dcc09" is_pre_election: true
I20260810 06:40:28.921989 30354 raft_consensus.cc:2454] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29acc47bef004e0facc6ee177ca10033 in term 0.
I20260810 06:40:28.922152 30548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caed7719c91441698372ae182c8fd8bb" candidate_uuid: "29acc47bef004e0facc6ee177ca10033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" is_pre_election: true
I20260810 06:40:28.922219 30655 leader_election.cc:302] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29acc47bef004e0facc6ee177ca10033, d9e6f52602a041e183511fcd196dcc09; no voters:
I20260810 06:40:28.922329 30548 raft_consensus.cc:2454] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29acc47bef004e0facc6ee177ca10033 in term 0.
I20260810 06:40:28.922338 30856 raft_consensus.cc:2781] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:28.922396 30856 raft_consensus.cc:482] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:28.922477 30856 raft_consensus.cc:3037] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:28.923233 30856 raft_consensus.cc:504] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.923383 30856 leader_election.cc:288] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc681e3fd7e4c3da9b699d79408c6fa (127.27.41.130:40991), d9e6f52602a041e183511fcd196dcc09 (127.27.41.129:33631)
I20260810 06:40:28.923530 30354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caed7719c91441698372ae182c8fd8bb" candidate_uuid: "29acc47bef004e0facc6ee177ca10033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e6f52602a041e183511fcd196dcc09"
I20260810 06:40:28.923599 30354 raft_consensus.cc:3037] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:28.924244 30354 raft_consensus.cc:2454] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29acc47bef004e0facc6ee177ca10033 in term 1.
I20260810 06:40:28.924363 30548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caed7719c91441698372ae182c8fd8bb" candidate_uuid: "29acc47bef004e0facc6ee177ca10033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa"
I20260810 06:40:28.924388 30655 leader_election.cc:302] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29acc47bef004e0facc6ee177ca10033, d9e6f52602a041e183511fcd196dcc09; no voters:
I20260810 06:40:28.924438 30548 raft_consensus.cc:3037] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:28.924500 30856 raft_consensus.cc:2781] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:28.924646 30856 raft_consensus.cc:686] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [term 1 LEADER]: Becoming Leader. State: Replica: 29acc47bef004e0facc6ee177ca10033, State: Running, Role: LEADER
I20260810 06:40:28.924718 30856 consensus_queue.cc:237] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.925474 30548 raft_consensus.cc:2454] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29acc47bef004e0facc6ee177ca10033 in term 1.
I20260810 06:40:28.925596 30138 catalog_manager.cc:5495] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29acc47bef004e0facc6ee177ca10033 (127.27.41.131). New cstate: current_term: 1 leader_uuid: "29acc47bef004e0facc6ee177ca10033" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } health_report { overall_health: HEALTHY } } }
Aug 10 06:40:28 dist-test-slave-bw88 krb5kdc[30077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344028, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:28.961544 30867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.954170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45329 (local address 127.0.0.1:47934)
0810 06:40:28.954328 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:28.954345 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:28.954404 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:28.954561 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:28.954562 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:28.954870 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:28.954926 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.954928 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.955573 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.955574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.956090 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:28.956091 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.956607 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.956608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:28.956650 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.957145 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:28.957149 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:28.958760 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:28.960339 (+ 1579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.960347 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.960350 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.960565 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.960766 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:28.960767 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:28.960767 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:28.960832 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:28.961064 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:28.961072 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:28.961120 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 06:40:28.961244 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 06:40:28.961391 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":87,"threads_started":1}
I20260810 06:40:28.961544 30204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:28.954248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47934 (local address 127.27.41.190:45329)
0810 06:40:28.954317 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:28.954319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:28.954451 (+ 132us) server_negotiation.cc:407] Connection header received
0810 06:40:28.954482 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:28.954483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:28.954493 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:28.954536 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:28.955014 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.955502 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.956293 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:28.956528 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:28.956593 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:28.958863 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:28.958865 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:28.958865 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:28.958878 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:28.960265 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.960639 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.960640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.960640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.960701 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:28.960891 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:28.960892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:28.960893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:28.960999 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:28.961073 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:28.961281 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 06:40:28.961449 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":95,"server-negotiator.queue_time_us":34}
I20260810 06:40:28.963637 30138 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:47934:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 06:40:28.963830 30138 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:28.965502 30523 tablet_service.cc:1467] Processing CreateTablet for tablet 3d5e0f4b483148d4b4242d73045e25e6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e7e9b93e066e4d1db6d3e8abc5d7349e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:40:28.965502 30330 tablet_service.cc:1467] Processing CreateTablet for tablet 3d5e0f4b483148d4b4242d73045e25e6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e7e9b93e066e4d1db6d3e8abc5d7349e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:40:28.965693 30330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d5e0f4b483148d4b4242d73045e25e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:28.965693 30523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d5e0f4b483148d4b4242d73045e25e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:28.965742 30726 tablet_service.cc:1467] Processing CreateTablet for tablet 3d5e0f4b483148d4b4242d73045e25e6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e7e9b93e066e4d1db6d3e8abc5d7349e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:40:28.965940 30726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d5e0f4b483148d4b4242d73045e25e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:28.967271 30853 tablet_bootstrap.cc:492] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: Bootstrap starting.
I20260810 06:40:28.967285 30849 tablet_bootstrap.cc:492] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033: Bootstrap starting.
I20260810 06:40:28.967281 30848 tablet_bootstrap.cc:492] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa: Bootstrap starting.
I20260810 06:40:28.967808 30849 tablet_bootstrap.cc:654] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:28.967948 30848 tablet_bootstrap.cc:654] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:28.968070 30853 tablet_bootstrap.cc:654] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:28.968829 30853 tablet_bootstrap.cc:492] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: No bootstrap required, opened a new log
I20260810 06:40:28.968854 30849 tablet_bootstrap.cc:492] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033: No bootstrap required, opened a new log
I20260810 06:40:28.968891 30853 ts_tablet_manager.cc:1397] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:40:28.968937 30849 ts_tablet_manager.cc:1397] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:40:28.969051 30853 raft_consensus.cc:348] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.969115 30853 raft_consensus.cc:374] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:28.969129 30853 raft_consensus.cc:729] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9e6f52602a041e183511fcd196dcc09, State: Initialized, Role: FOLLOWER
I20260810 06:40:28.969136 30849 raft_consensus.cc:348] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.969193 30853 consensus_queue.cc:260] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.969220 30849 raft_consensus.cc:374] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:28.969244 30849 raft_consensus.cc:729] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29acc47bef004e0facc6ee177ca10033, State: Initialized, Role: FOLLOWER
I20260810 06:40:28.969292 30853 ts_tablet_manager.cc:1428] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:28.969292 30849 consensus_queue.cc:260] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.969403 30849 ts_tablet_manager.cc:1428] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:28.969386 30857 tablet_replica.cc:439] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } } }
I20260810 06:40:28.969472 30857 tablet_replica.cc:442] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:28.969568 30856 tablet_replica.cc:439] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } } }
I20260810 06:40:28.969656 30856 tablet_replica.cc:442] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:28.969923 30848 tablet_bootstrap.cc:492] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa: No bootstrap required, opened a new log
I20260810 06:40:28.969981 30848 ts_tablet_manager.cc:1397] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260810 06:40:28.970173 30848 raft_consensus.cc:348] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.970292 30848 raft_consensus.cc:374] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:28.970325 30848 raft_consensus.cc:729] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc681e3fd7e4c3da9b699d79408c6fa, State: Initialized, Role: FOLLOWER
I20260810 06:40:28.970369 30848 consensus_queue.cc:260] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:28.970471 30848 ts_tablet_manager.cc:1428] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:28.970546 30854 tablet_replica.cc:439] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } } }
I20260810 06:40:28.970638 30854 tablet_replica.cc:442] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa: This TxnStatusTablet replica's current role is: FOLLOWER
W20260810 06:40:29.004599 30422 tablet.cc:2369] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:40:29.081974 30815 tablet.cc:2369] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:40:29.385042 30857 raft_consensus.cc:482] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:29.385151 30857 raft_consensus.cc:504] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:29.385583 30857 leader_election.cc:288] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc681e3fd7e4c3da9b699d79408c6fa (127.27.41.130:40991), 29acc47bef004e0facc6ee177ca10033 (127.27.41.131:38251)
I20260810 06:40:29.388963 30872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.385771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:38251 (local address 127.27.41.129:35749)
0810 06:40:29.385912 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:29.385924 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:29.385980 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:29.386206 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:29.386207 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:29.386209 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:29.386309 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.386311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.386968 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.386970 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.387944 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.387947 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.388687 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.388688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.388761 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.388766 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:40:29.388817 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 06:40:29.388849 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":15,"thread_start_us":70,"threads_started":1}
I20260810 06:40:29.388983 30873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.385861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:35749 (local address 127.27.41.131:38251)
0810 06:40:29.385980 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:29.385982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:29.385993 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:40:29.386090 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:29.386092 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:29.386102 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:29.386187 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:29.386390 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.386849 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.388090 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.388599 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.388679 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.388689 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:29.388855 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 06:40:29.388908 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":51,"threads_started":1}
I20260810 06:40:29.389039 30844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.385867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:36967 (local address 127.27.41.130:40991)
0810 06:40:29.385916 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:29.385918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:29.386025 (+ 107us) server_negotiation.cc:407] Connection header received
0810 06:40:29.386088 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:29.386089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:29.386105 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:29.386150 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:29.386320 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.386832 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.388083 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.388616 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.388697 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.388706 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:29.388910 (+ 204us) server_negotiation.cc:299] Negotiation successful
0810 06:40:29.388965 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 06:40:29.389191 30871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.385798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:40991 (local address 127.27.41.129:36967)
0810 06:40:29.385939 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:29.385951 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:29.386022 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:29.386174 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:29.386175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:29.386177 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:29.386253 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.386255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.386915 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.386916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.388005 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.388009 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.388744 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.388745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.388797 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.388834 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 06:40:29.388890 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 06:40:29.388927 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":24,"thread_start_us":62,"threads_started":1}
I20260810 06:40:29.389470 30755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e0f4b483148d4b4242d73045e25e6" candidate_uuid: "d9e6f52602a041e183511fcd196dcc09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29acc47bef004e0facc6ee177ca10033" is_pre_election: true
I20260810 06:40:29.389492 30548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e0f4b483148d4b4242d73045e25e6" candidate_uuid: "d9e6f52602a041e183511fcd196dcc09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" is_pre_election: true
I20260810 06:40:29.389585 30755 raft_consensus.cc:2454] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e6f52602a041e183511fcd196dcc09 in term 0.
I20260810 06:40:29.389600 30548 raft_consensus.cc:2454] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9e6f52602a041e183511fcd196dcc09 in term 0.
I20260810 06:40:29.389763 30263 leader_election.cc:302] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc681e3fd7e4c3da9b699d79408c6fa, d9e6f52602a041e183511fcd196dcc09; no voters:
I20260810 06:40:29.389937 30857 raft_consensus.cc:2781] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:29.389986 30857 raft_consensus.cc:482] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:29.390007 30857 raft_consensus.cc:3037] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:29.390753 30857 raft_consensus.cc:504] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:29.390899 30857 leader_election.cc:288] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc681e3fd7e4c3da9b699d79408c6fa (127.27.41.130:40991), 29acc47bef004e0facc6ee177ca10033 (127.27.41.131:38251)
I20260810 06:40:29.391055 30548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e0f4b483148d4b4242d73045e25e6" candidate_uuid: "d9e6f52602a041e183511fcd196dcc09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa"
I20260810 06:40:29.391067 30755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e0f4b483148d4b4242d73045e25e6" candidate_uuid: "d9e6f52602a041e183511fcd196dcc09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29acc47bef004e0facc6ee177ca10033"
I20260810 06:40:29.391140 30548 raft_consensus.cc:3037] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:29.391140 30755 raft_consensus.cc:3037] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:29.391865 30548 raft_consensus.cc:2454] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e6f52602a041e183511fcd196dcc09 in term 1.
I20260810 06:40:29.391921 30755 raft_consensus.cc:2454] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9e6f52602a041e183511fcd196dcc09 in term 1.
I20260810 06:40:29.392068 30263 leader_election.cc:302] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc681e3fd7e4c3da9b699d79408c6fa, d9e6f52602a041e183511fcd196dcc09; no voters:
I20260810 06:40:29.392153 30857 raft_consensus.cc:2781] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:29.392263 30857 raft_consensus.cc:686] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [term 1 LEADER]: Becoming Leader. State: Replica: d9e6f52602a041e183511fcd196dcc09, State: Running, Role: LEADER
I20260810 06:40:29.392392 30857 consensus_queue.cc:237] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:29.392817 30874 tablet_replica.cc:439] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: TxnStatusTablet state changed. Reason: New leader d9e6f52602a041e183511fcd196dcc09. Latest consensus state: current_term: 1 leader_uuid: "d9e6f52602a041e183511fcd196dcc09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } } }
I20260810 06:40:29.392901 30874 tablet_replica.cc:442] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:40:29.393098 30877 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 06:40:29.393215 30877 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 06:40:29.393224 30137 catalog_manager.cc:5495] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9e6f52602a041e183511fcd196dcc09 (127.27.41.129). New cstate: current_term: 1 leader_uuid: "d9e6f52602a041e183511fcd196dcc09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } health_report { overall_health: UNKNOWN } } }
I20260810 06:40:29.403264 30856 consensus_queue.cc:1035] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:29.405205 30859 consensus_queue.cc:1035] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:29.411576 30843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.409147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52714 (local address 127.27.41.129:33631)
0810 06:40:29.409193 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:29.409196 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:29.409205 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:29.409292 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:29.409292 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:29.409308 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:29.409412 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:29.409535 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.409999 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.410761 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.410967 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.411053 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.411255 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:29.411354 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:29.411443 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:29.411489 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 06:40:29.411509 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 06:40:29.411625 30867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.409081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:33631 (local address 127.0.0.1:52714)
0810 06:40:29.409152 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:29.409164 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:29.409215 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:29.409415 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:29.409416 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:29.409417 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:40:29.409466 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.409469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.410092 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.410093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.410661 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.410663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.411057 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.411058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.411124 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.411149 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:40:29.411422 (+ 273us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:40:29.411433 (+ 11us) client_negotiation.cc:769] Sending connection context
0810 06:40:29.411485 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 06:40:29.411536 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 06:40:29.413391 30755 raft_consensus.cc:1261] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Refusing update from remote peer d9e6f52602a041e183511fcd196dcc09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:29.413393 30548 raft_consensus.cc:1261] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Refusing update from remote peer d9e6f52602a041e183511fcd196dcc09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:29.413695 30874 consensus_queue.cc:1035] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:29.413806 30857 consensus_queue.cc:1035] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:29.414835 30854 tablet_replica.cc:439] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa: TxnStatusTablet state changed. Reason: New leader d9e6f52602a041e183511fcd196dcc09. Latest consensus state: current_term: 1 leader_uuid: "d9e6f52602a041e183511fcd196dcc09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } } }
I20260810 06:40:29.414855 30859 tablet_replica.cc:439] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033: TxnStatusTablet state changed. Reason: New leader d9e6f52602a041e183511fcd196dcc09. Latest consensus state: current_term: 1 leader_uuid: "d9e6f52602a041e183511fcd196dcc09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } } }
I20260810 06:40:29.414933 30854 tablet_replica.cc:442] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:29.414952 30859 tablet_replica.cc:442] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:29.415936 30874 tablet_replica.cc:439] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d9e6f52602a041e183511fcd196dcc09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } } }
I20260810 06:40:29.416034 30874 tablet_replica.cc:442] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:40:29.416013 30854 tablet_replica.cc:439] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d9e6f52602a041e183511fcd196dcc09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } } }
I20260810 06:40:29.416086 30854 tablet_replica.cc:442] T 3d5e0f4b483148d4b4242d73045e25e6 P 9bc681e3fd7e4c3da9b699d79408c6fa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:29.416092 30874 tablet_replica.cc:439] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d9e6f52602a041e183511fcd196dcc09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } } }
I20260810 06:40:29.416143 30874 tablet_replica.cc:442] T 3d5e0f4b483148d4b4242d73045e25e6 P d9e6f52602a041e183511fcd196dcc09: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:40:29.416456 30882 mvcc.cc:205] Tried to move back new op lower bound from 7316865144474791936 to 7316865144391774208. Current Snapshot: MvccSnapshot[applied={T|T < 7316865144474791936}]
I20260810 06:40:29.416493 30881 mvcc.cc:205] Tried to move back new op lower bound from 7316865144474791936 to 7316865144391774208. Current Snapshot: MvccSnapshot[applied={T|T < 7316865144474791936}]
I20260810 06:40:29.416591 30859 tablet_replica.cc:439] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d9e6f52602a041e183511fcd196dcc09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } } }
I20260810 06:40:29.416649 30859 tablet_replica.cc:442] T 3d5e0f4b483148d4b4242d73045e25e6 P 29acc47bef004e0facc6ee177ca10033: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:29.421273 30873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.418526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32880 (local address 127.27.41.131:38251)
0810 06:40:29.418588 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:29.418590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:29.418728 (+ 138us) server_negotiation.cc:407] Connection header received
0810 06:40:29.418766 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:29.418767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:29.418785 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:29.418863 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:29.418942 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.419695 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.420425 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.420743 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.420816 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.420951 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:29.421067 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:29.421156 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:29.421181 (+ 25us) server_negotiation.cc:299] Negotiation successful
0810 06:40:29.421204 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 06:40:29.426023 30843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.423614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:57549 (local address 127.27.41.129:33631)
0810 06:40:29.423655 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:29.423657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:29.423700 (+ 43us) server_negotiation.cc:407] Connection header received
0810 06:40:29.423762 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:29.423763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:29.423772 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:29.423825 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:29.423954 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.424406 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.425212 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.425474 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.425558 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.425748 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:29.425797 (+ 49us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:29.425859 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:29.425931 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 06:40:29.425950 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 06:40:29.426043 30901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.423512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:33631 (local address 127.27.41.131:57549)
0810 06:40:29.423651 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:29.423661 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:29.423716 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:29.423829 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:29.423830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:29.423831 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:40:29.423886 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.423887 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.424489 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.424490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.425129 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.425132 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.425562 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.425563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.425628 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.425648 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:40:29.425876 (+ 228us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:40:29.425878 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:40:29.425927 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 06:40:29.425970 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":61,"threads_started":1}
I20260810 06:40:29.436456 30873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.433599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:39341 (local address 127.27.41.131:38251)
0810 06:40:29.433637 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:29.433639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:29.433840 (+ 201us) server_negotiation.cc:407] Connection header received
0810 06:40:29.433862 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:29.433863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:29.433874 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:29.433929 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:29.434106 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.434827 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.435571 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.435867 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.435940 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.436236 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:29.436269 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:29.436330 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:29.436363 (+ 33us) server_negotiation.cc:299] Negotiation successful
0810 06:40:29.436385 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 06:40:29.436702 30905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.433569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:38251 (local address 127.27.41.129:39341)
0810 06:40:29.433714 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:29.433724 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:29.433795 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:29.433933 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:29.433934 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:29.433950 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:40:29.434043 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.434045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.434905 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.434905 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.435485 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.435487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.436073 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.436074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.436144 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.436158 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:40:29.436329 (+ 171us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:40:29.436330 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 06:40:29.436360 (+ 30us) client_negotiation.cc:240] Negotiation successful
0810 06:40:29.436436 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":75,"threads_started":1}
I20260810 06:40:29.447506 30138 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:29.447635 30138 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:29.448397 30138 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514: Sending DeleteTablet for 3 replicas of tablet caed7719c91441698372ae182c8fd8bb
I20260810 06:40:29.448777 30330 tablet_service.cc:1514] Processing DeleteTablet for tablet caed7719c91441698372ae182c8fd8bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:29 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:52702
I20260810 06:40:29.448778 30523 tablet_service.cc:1514] Processing DeleteTablet for tablet caed7719c91441698372ae182c8fd8bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:29 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:59806
I20260810 06:40:29.449110 30910 tablet_replica.cc:330] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09: stopping tablet replica
I20260810 06:40:29.449155 30726 tablet_service.cc:1514] Processing DeleteTablet for tablet caed7719c91441698372ae182c8fd8bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:29 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:32874
I20260810 06:40:29.449309 30910 raft_consensus.cc:2229] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:29.449448 30910 raft_consensus.cc:2258] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:29.449618 30138 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:40:29.449784 30138 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:29.450124 30910 ts_tablet_manager.cc:1905] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:29.450861 30330 tablet_service.cc:1467] Processing CreateTablet for tablet 6b043e16e01345429a1f9234b1e267b8 (DEFAULT_TABLE table=test-table [id=cf35417aa23d4e5a9f74d0fc42091c4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:29.451004 30330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b043e16e01345429a1f9234b1e267b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:29.452339 30853 tablet_bootstrap.cc:492] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09: Bootstrap starting.
I20260810 06:40:29.452356 30910 ts_tablet_manager.cc:1918] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:29.452579 30910 log.cc:1196] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/wal/wals/caed7719c91441698372ae182c8fd8bb
I20260810 06:40:29.452828 30853 tablet_bootstrap.cc:654] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:29.453025 30910 ts_tablet_manager.cc:1939] T caed7719c91441698372ae182c8fd8bb P d9e6f52602a041e183511fcd196dcc09: Deleting consensus metadata
I20260810 06:40:29.453421 30523 tablet_service.cc:1467] Processing CreateTablet for tablet 6b043e16e01345429a1f9234b1e267b8 (DEFAULT_TABLE table=test-table [id=cf35417aa23d4e5a9f74d0fc42091c4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:29.453557 30523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b043e16e01345429a1f9234b1e267b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:29.453581 30121 catalog_manager.cc:4841] TS d9e6f52602a041e183511fcd196dcc09 (127.27.41.129:33631): tablet caed7719c91441698372ae182c8fd8bb (table test-table [id=224907c86ee146879faf15902626fce0]) successfully deleted
I20260810 06:40:29.454871 30848 tablet_bootstrap.cc:492] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa: Bootstrap starting.
I20260810 06:40:29.455214 30726 tablet_service.cc:1467] Processing CreateTablet for tablet 6b043e16e01345429a1f9234b1e267b8 (DEFAULT_TABLE table=test-table [id=cf35417aa23d4e5a9f74d0fc42091c4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:29.455286 30848 tablet_bootstrap.cc:654] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:29.455329 30726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b043e16e01345429a1f9234b1e267b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:29.456096 30848 tablet_bootstrap.cc:492] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa: No bootstrap required, opened a new log
I20260810 06:40:29.456146 30848 ts_tablet_manager.cc:1397] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:29.456287 30848 raft_consensus.cc:348] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:29.456354 30848 raft_consensus.cc:374] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:29.456375 30848 raft_consensus.cc:729] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc681e3fd7e4c3da9b699d79408c6fa, State: Initialized, Role: FOLLOWER
I20260810 06:40:29.456416 30848 consensus_queue.cc:260] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:29.456514 30848 ts_tablet_manager.cc:1428] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:29.456636 30849 tablet_bootstrap.cc:492] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033: Bootstrap starting.
I20260810 06:40:29.457052 30849 tablet_bootstrap.cc:654] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:29.458061 30849 tablet_bootstrap.cc:492] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033: No bootstrap required, opened a new log
I20260810 06:40:29.458127 30849 ts_tablet_manager.cc:1397] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 06:40:29.458261 30849 raft_consensus.cc:348] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:29.458341 30849 raft_consensus.cc:374] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:29.458364 30849 raft_consensus.cc:729] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29acc47bef004e0facc6ee177ca10033, State: Initialized, Role: FOLLOWER
I20260810 06:40:29.458410 30849 consensus_queue.cc:260] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:29.458504 30849 ts_tablet_manager.cc:1428] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:29.459779 30853 tablet_bootstrap.cc:492] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09: No bootstrap required, opened a new log
I20260810 06:40:29.459836 30853 ts_tablet_manager.cc:1397] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20260810 06:40:29.460136 30853 raft_consensus.cc:348] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:29.460235 30853 raft_consensus.cc:374] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:29.460256 30853 raft_consensus.cc:729] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9e6f52602a041e183511fcd196dcc09, State: Initialized, Role: FOLLOWER
I20260810 06:40:29.460302 30853 consensus_queue.cc:260] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:29.460403 30853 ts_tablet_manager.cc:1428] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:29.460733 30913 tablet_replica.cc:330] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033: stopping tablet replica
I20260810 06:40:29.460834 30913 raft_consensus.cc:2229] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:40:29.460925 30913 raft_consensus.cc:2258] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:29.461319 30913 ts_tablet_manager.cc:1905] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:29.462893 30913 ts_tablet_manager.cc:1918] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:29.462968 30913 log.cc:1196] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/caed7719c91441698372ae182c8fd8bb
I20260810 06:40:29.463227 30913 ts_tablet_manager.cc:1939] T caed7719c91441698372ae182c8fd8bb P 29acc47bef004e0facc6ee177ca10033: Deleting consensus metadata
I20260810 06:40:29.463613 30912 tablet_replica.cc:330] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa: stopping tablet replica
I20260810 06:40:29.463625 30125 catalog_manager.cc:4841] TS 29acc47bef004e0facc6ee177ca10033 (127.27.41.131:38251): tablet caed7719c91441698372ae182c8fd8bb (table test-table [id=224907c86ee146879faf15902626fce0]) successfully deleted
I20260810 06:40:29.463732 30912 raft_consensus.cc:2229] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:29.463789 30912 raft_consensus.cc:2258] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:29.464151 30912 ts_tablet_manager.cc:1905] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:29.465734 30912 ts_tablet_manager.cc:1918] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:29.465809 30912 log.cc:1196] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/caed7719c91441698372ae182c8fd8bb
I20260810 06:40:29.466073 30912 ts_tablet_manager.cc:1939] T caed7719c91441698372ae182c8fd8bb P 9bc681e3fd7e4c3da9b699d79408c6fa: Deleting consensus metadata
I20260810 06:40:29.466516 30123 catalog_manager.cc:4841] TS 9bc681e3fd7e4c3da9b699d79408c6fa (127.27.41.130:40991): tablet caed7719c91441698372ae182c8fd8bb (table test-table [id=224907c86ee146879faf15902626fce0]) successfully deleted
I20260810 06:40:29.505054 30854 raft_consensus.cc:482] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:29.505160 30854 raft_consensus.cc:504] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:29.505529 30854 leader_election.cc:288] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9e6f52602a041e183511fcd196dcc09 (127.27.41.129:33631), 29acc47bef004e0facc6ee177ca10033 (127.27.41.131:38251)
I20260810 06:40:29.510409 30843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.505917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:51023 (local address 127.27.41.129:33631)
0810 06:40:29.505964 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:29.505966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:29.506964 (+ 998us) server_negotiation.cc:407] Connection header received
0810 06:40:29.507066 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:29.507067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:29.507080 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:29.507108 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:29.507330 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.508068 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.509526 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.510017 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.510071 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.510081 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:29.510311 (+ 230us) server_negotiation.cc:299] Negotiation successful
0810 06:40:29.510344 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 06:40:29.510896 30920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.505759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:33631 (local address 127.27.41.130:51023)
0810 06:40:29.506903 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:29.506915 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:29.506994 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:29.507174 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:29.507175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:29.507177 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:29.507251 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.507253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.508173 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.508174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.509410 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.509413 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.510144 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.510145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.510217 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.510221 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:29.510767 (+ 546us) client_negotiation.cc:240] Negotiation successful
0810 06:40:29.510815 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1116,"thread_start_us":63,"threads_started":1}
I20260810 06:40:29.510972 30873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.506201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:55599 (local address 127.27.41.131:38251)
0810 06:40:29.506241 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:29.506243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:29.507356 (+ 1113us) server_negotiation.cc:407] Connection header received
0810 06:40:29.507469 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:29.507470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:29.507480 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:29.507508 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:29.507756 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.508461 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.509977 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.510526 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.510584 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.510593 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:29.510866 (+ 273us) server_negotiation.cc:299] Negotiation successful
0810 06:40:29.510902 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:40:29.511243 30919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.506083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:38251 (local address 127.27.41.130:55599)
0810 06:40:29.507279 (+ 1196us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:29.507291 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:29.507388 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:29.507590 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:29.507590 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:29.507592 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:29.507681 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.507682 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.508592 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.508594 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.509868 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.509872 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.510673 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.510674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.510781 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.510785 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:29.511100 (+ 315us) client_negotiation.cc:240] Negotiation successful
0810 06:40:29.511139 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1179,"thread_start_us":37,"threads_started":1}
I20260810 06:40:29.511409 30354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b043e16e01345429a1f9234b1e267b8" candidate_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e6f52602a041e183511fcd196dcc09" is_pre_election: true
I20260810 06:40:29.511516 30354 raft_consensus.cc:2454] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc681e3fd7e4c3da9b699d79408c6fa in term 0.
I20260810 06:40:29.511487 30755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b043e16e01345429a1f9234b1e267b8" candidate_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29acc47bef004e0facc6ee177ca10033" is_pre_election: true
I20260810 06:40:29.511583 30755 raft_consensus.cc:2454] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc681e3fd7e4c3da9b699d79408c6fa in term 0.
I20260810 06:40:29.511706 30451 leader_election.cc:302] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc681e3fd7e4c3da9b699d79408c6fa, d9e6f52602a041e183511fcd196dcc09; no voters:
I20260810 06:40:29.511866 30854 raft_consensus.cc:2781] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:29.511902 30854 raft_consensus.cc:482] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:29.511926 30854 raft_consensus.cc:3037] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:29.512866 30854 raft_consensus.cc:504] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:29.513012 30854 leader_election.cc:288] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [CANDIDATE]: Term 1 election: Requested vote from peers d9e6f52602a041e183511fcd196dcc09 (127.27.41.129:33631), 29acc47bef004e0facc6ee177ca10033 (127.27.41.131:38251)
I20260810 06:40:29.513212 30755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b043e16e01345429a1f9234b1e267b8" candidate_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29acc47bef004e0facc6ee177ca10033"
I20260810 06:40:29.513290 30755 raft_consensus.cc:3037] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:29.513262 30354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b043e16e01345429a1f9234b1e267b8" candidate_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e6f52602a041e183511fcd196dcc09"
I20260810 06:40:29.513357 30354 raft_consensus.cc:3037] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:29.514060 30755 raft_consensus.cc:2454] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc681e3fd7e4c3da9b699d79408c6fa in term 1.
I20260810 06:40:29.514235 30456 leader_election.cc:302] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29acc47bef004e0facc6ee177ca10033, 9bc681e3fd7e4c3da9b699d79408c6fa; no voters:
I20260810 06:40:29.514261 30354 raft_consensus.cc:2454] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc681e3fd7e4c3da9b699d79408c6fa in term 1.
I20260810 06:40:29.514314 30854 raft_consensus.cc:2781] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:29.514453 30854 raft_consensus.cc:686] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 LEADER]: Becoming Leader. State: Replica: 9bc681e3fd7e4c3da9b699d79408c6fa, State: Running, Role: LEADER
I20260810 06:40:29.514542 30854 consensus_queue.cc:237] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:29.515213 30137 catalog_manager.cc:5495] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc681e3fd7e4c3da9b699d79408c6fa (127.27.41.130). New cstate: current_term: 1 leader_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } health_report { overall_health: UNKNOWN } } }
I20260810 06:40:29.526087 30844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.522957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59820 (local address 127.27.41.130:40991)
0810 06:40:29.523020 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:29.523022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:29.523032 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:40:29.523068 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:29.523069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:29.523088 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:29.523168 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:29.523324 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.524069 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.525140 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.525456 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.525542 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.525714 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:29.525841 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:29.525921 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:29.525999 (+ 78us) server_negotiation.cc:299] Negotiation successful
0810 06:40:29.526020 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 06:40:29.532541 30843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.528817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:40187 (local address 127.27.41.129:33631)
0810 06:40:29.528861 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:29.528863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:29.529575 (+ 712us) server_negotiation.cc:407] Connection header received
0810 06:40:29.529613 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:29.529614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:29.529626 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:29.529690 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:29.529840 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.530543 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.531660 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.531951 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.532029 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.532259 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:29.532295 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:29.532356 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:29.532432 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 06:40:29.532456 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:40:29.532588 30926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.528745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:33631 (local address 127.27.41.130:40187)
0810 06:40:29.529483 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:29.529495 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:29.529564 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:29.529692 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:29.529693 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:29.529695 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:40:29.529764 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.529766 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.530643 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.530644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.531559 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.531562 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.532070 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.532072 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.532140 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.532158 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:40:29.532372 (+ 214us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:40:29.532375 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:29.532430 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 06:40:29.532485 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":77,"threads_started":1}
I20260810 06:40:29.535229 30354 raft_consensus.cc:1261] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Refusing update from remote peer 9bc681e3fd7e4c3da9b699d79408c6fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:29.535274 30755 raft_consensus.cc:1261] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Refusing update from remote peer 9bc681e3fd7e4c3da9b699d79408c6fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:29.535616 30854 consensus_queue.cc:1035] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:29.535765 30921 consensus_queue.cc:1035] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:29.537621 30885 mvcc.cc:205] Tried to move back new op lower bound from 7316865144974270464 to 7316865144891977728. Current Snapshot: MvccSnapshot[applied={T|T < 7316865144974270464}]
I20260810 06:40:29.546515 30905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.542051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:40991 (local address 127.27.41.129:49641)
0810 06:40:29.542112 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:29.542124 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:29.542167 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:29.543780 (+ 1613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:29.543781 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:29.543782 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:40:29.543824 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.543825 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.544710 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.544711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.545674 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:29.545678 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.546140 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.546141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:29.546191 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.546198 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:40:29.546352 (+ 154us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:40:29.546354 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:40:29.546391 (+ 37us) client_negotiation.cc:240] Negotiation successful
0810 06:40:29.546435 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 06:40:29.546991 30844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:29.543573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:49641 (local address 127.27.41.130:40991)
0810 06:40:29.543636 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:29.543638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:29.543646 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:40:29.543669 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:29.543669 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:29.543679 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:29.543732 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:29.543890 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.544620 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.545772 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:29.546054 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:29.546110 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:29.546263 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:29.546295 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:29.546334 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:29.546901 (+ 567us) server_negotiation.cc:299] Negotiation successful
0810 06:40:29.546924 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 06:40:29.547768 30885 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 06:40:31.071015 30138 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:31.071117 30138 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:31.071833 30138 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514: Sending DeleteTablet for 3 replicas of tablet 6b043e16e01345429a1f9234b1e267b8
I20260810 06:40:31.072082 30330 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b043e16e01345429a1f9234b1e267b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:31 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:52702
I20260810 06:40:31.072124 30523 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b043e16e01345429a1f9234b1e267b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:31 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:59806
I20260810 06:40:31.072119 30726 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b043e16e01345429a1f9234b1e267b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:31 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:32874
I20260810 06:40:31.072283 30956 tablet_replica.cc:330] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa: stopping tablet replica
I20260810 06:40:31.072340 30956 raft_consensus.cc:2229] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:40:31.072431 30956 raft_consensus.cc:2258] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:31.072731 30956 ts_tablet_manager.cc:1905] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:31.073406 30957 tablet_replica.cc:330] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033: stopping tablet replica
I20260810 06:40:31.073493 30957 raft_consensus.cc:2229] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:31.073541 30957 raft_consensus.cc:2258] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:31.073771 30957 ts_tablet_manager.cc:1905] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:31.074923 30956 ts_tablet_manager.cc:1918] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 06:40:31.074997 30956 log.cc:1196] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/6b043e16e01345429a1f9234b1e267b8
I20260810 06:40:31.075269 30956 ts_tablet_manager.cc:1939] T 6b043e16e01345429a1f9234b1e267b8 P 9bc681e3fd7e4c3da9b699d79408c6fa: Deleting consensus metadata
I20260810 06:40:31.075527 30957 ts_tablet_manager.cc:1918] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 06:40:31.075594 30957 log.cc:1196] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/6b043e16e01345429a1f9234b1e267b8
I20260810 06:40:31.075634 30123 catalog_manager.cc:4841] TS 9bc681e3fd7e4c3da9b699d79408c6fa (127.27.41.130:40991): tablet 6b043e16e01345429a1f9234b1e267b8 (table test-table [id=cf35417aa23d4e5a9f74d0fc42091c4a]) successfully deleted
I20260810 06:40:31.075832 30957 ts_tablet_manager.cc:1939] T 6b043e16e01345429a1f9234b1e267b8 P 29acc47bef004e0facc6ee177ca10033: Deleting consensus metadata
I20260810 06:40:31.076212 30125 catalog_manager.cc:4841] TS 29acc47bef004e0facc6ee177ca10033 (127.27.41.131:38251): tablet 6b043e16e01345429a1f9234b1e267b8 (table test-table [id=cf35417aa23d4e5a9f74d0fc42091c4a]) successfully deleted
I20260810 06:40:31.076913 30955 tablet_replica.cc:330] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09: stopping tablet replica
I20260810 06:40:31.076983 30955 raft_consensus.cc:2229] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:31.077020 30955 raft_consensus.cc:2258] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:31.077245 30955 ts_tablet_manager.cc:1905] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:31.079267 30955 ts_tablet_manager.cc:1918] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 06:40:31.079340 30955 log.cc:1196] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/wal/wals/6b043e16e01345429a1f9234b1e267b8
I20260810 06:40:31.079576 30955 ts_tablet_manager.cc:1939] T 6b043e16e01345429a1f9234b1e267b8 P d9e6f52602a041e183511fcd196dcc09: Deleting consensus metadata
I20260810 06:40:31.079883 30121 catalog_manager.cc:4841] TS d9e6f52602a041e183511fcd196dcc09 (127.27.41.129:33631): tablet 6b043e16e01345429a1f9234b1e267b8 (table test-table [id=cf35417aa23d4e5a9f74d0fc42091c4a]) successfully deleted
Aug 10 06:40:31 dist-test-slave-bw88 krb5kdc[30077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344031, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 06:40:31 dist-test-slave-bw88 krb5kdc[30077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344031, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:31.101002 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:31.093768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47936 (local address 127.27.41.190:45329)
0810 06:40:31.093910 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:31.093912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:31.093937 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:40:31.094005 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:31.094006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:31.094017 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:31.094094 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:31.094655 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:31.095174 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:31.095925 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:31.096171 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:31.096268 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:31.098658 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:31.098659 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:31.098659 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:31.098666 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:31.099969 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:31.100321 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:31.100322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:31.100322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:31.100386 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:31.100607 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:31.100607 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:31.100607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:31.100706 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:31.100780 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:31.100873 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 06:40:31.100935 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":71,"threads_started":1}
I20260810 06:40:31.102550 30138 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47936:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:40:31.102720 30138 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:31.104084 30330 tablet_service.cc:1467] Processing CreateTablet for tablet 40b2a8392ed6447f9a0d1e58faa4836a (DEFAULT_TABLE table=test-table [id=0335f3b4a5d2422890415d31204b8766]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:31.104101 30523 tablet_service.cc:1467] Processing CreateTablet for tablet 40b2a8392ed6447f9a0d1e58faa4836a (DEFAULT_TABLE table=test-table [id=0335f3b4a5d2422890415d31204b8766]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:31.104224 30330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40b2a8392ed6447f9a0d1e58faa4836a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:31.104236 30523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40b2a8392ed6447f9a0d1e58faa4836a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:31.104213 30726 tablet_service.cc:1467] Processing CreateTablet for tablet 40b2a8392ed6447f9a0d1e58faa4836a (DEFAULT_TABLE table=test-table [id=0335f3b4a5d2422890415d31204b8766]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:31.104331 30726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40b2a8392ed6447f9a0d1e58faa4836a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:31.105667 30969 tablet_bootstrap.cc:492] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa: Bootstrap starting.
I20260810 06:40:31.105803 30971 tablet_bootstrap.cc:492] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09: Bootstrap starting.
I20260810 06:40:31.105844 30972 tablet_bootstrap.cc:492] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033: Bootstrap starting.
I20260810 06:40:31.106163 30969 tablet_bootstrap.cc:654] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:31.106262 30971 tablet_bootstrap.cc:654] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:31.106262 30972 tablet_bootstrap.cc:654] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:31.106899 30969 tablet_bootstrap.cc:492] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa: No bootstrap required, opened a new log
I20260810 06:40:31.106899 30972 tablet_bootstrap.cc:492] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033: No bootstrap required, opened a new log
I20260810 06:40:31.106956 30969 ts_tablet_manager.cc:1397] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:31.106956 30972 ts_tablet_manager.cc:1397] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:31.107079 30971 tablet_bootstrap.cc:492] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09: No bootstrap required, opened a new log
I20260810 06:40:31.107075 30969 raft_consensus.cc:348] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.107132 30971 ts_tablet_manager.cc:1397] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:31.107141 30969 raft_consensus.cc:374] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:31.107075 30972 raft_consensus.cc:348] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.107165 30969 raft_consensus.cc:729] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc681e3fd7e4c3da9b699d79408c6fa, State: Initialized, Role: FOLLOWER
I20260810 06:40:31.107168 30972 raft_consensus.cc:374] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:31.107192 30972 raft_consensus.cc:729] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29acc47bef004e0facc6ee177ca10033, State: Initialized, Role: FOLLOWER
I20260810 06:40:31.107214 30969 consensus_queue.cc:260] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.107275 30971 raft_consensus.cc:348] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.107322 30969 ts_tablet_manager.cc:1428] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:31.107349 30971 raft_consensus.cc:374] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:31.107376 30971 raft_consensus.cc:729] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9e6f52602a041e183511fcd196dcc09, State: Initialized, Role: FOLLOWER
I20260810 06:40:31.107429 30971 consensus_queue.cc:260] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.107249 30972 consensus_queue.cc:260] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.107641 30971 ts_tablet_manager.cc:1428] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:31.108006 30972 ts_tablet_manager.cc:1428] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:31.151537 30978 raft_consensus.cc:482] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:31.151635 30978 raft_consensus.cc:504] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.151829 30978 leader_election.cc:288] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9e6f52602a041e183511fcd196dcc09 (127.27.41.129:33631), 9bc681e3fd7e4c3da9b699d79408c6fa (127.27.41.130:40991)
I20260810 06:40:31.152087 30548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b2a8392ed6447f9a0d1e58faa4836a" candidate_uuid: "29acc47bef004e0facc6ee177ca10033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" is_pre_election: true
I20260810 06:40:31.152086 30354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b2a8392ed6447f9a0d1e58faa4836a" candidate_uuid: "29acc47bef004e0facc6ee177ca10033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e6f52602a041e183511fcd196dcc09" is_pre_election: true
I20260810 06:40:31.152199 30548 raft_consensus.cc:2454] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29acc47bef004e0facc6ee177ca10033 in term 0.
I20260810 06:40:31.152199 30354 raft_consensus.cc:2454] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29acc47bef004e0facc6ee177ca10033 in term 0.
I20260810 06:40:31.152359 30659 leader_election.cc:302] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29acc47bef004e0facc6ee177ca10033, 9bc681e3fd7e4c3da9b699d79408c6fa; no voters:
I20260810 06:40:31.152510 30978 raft_consensus.cc:2781] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:31.152587 30978 raft_consensus.cc:482] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:31.152619 30978 raft_consensus.cc:3037] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:31.153419 30978 raft_consensus.cc:504] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.153578 30978 leader_election.cc:288] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [CANDIDATE]: Term 1 election: Requested vote from peers d9e6f52602a041e183511fcd196dcc09 (127.27.41.129:33631), 9bc681e3fd7e4c3da9b699d79408c6fa (127.27.41.130:40991)
I20260810 06:40:31.153738 30354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b2a8392ed6447f9a0d1e58faa4836a" candidate_uuid: "29acc47bef004e0facc6ee177ca10033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e6f52602a041e183511fcd196dcc09"
I20260810 06:40:31.153733 30548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40b2a8392ed6447f9a0d1e58faa4836a" candidate_uuid: "29acc47bef004e0facc6ee177ca10033" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa"
I20260810 06:40:31.153817 30354 raft_consensus.cc:3037] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:31.153817 30548 raft_consensus.cc:3037] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:31.154639 30548 raft_consensus.cc:2454] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29acc47bef004e0facc6ee177ca10033 in term 1.
I20260810 06:40:31.154639 30354 raft_consensus.cc:2454] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29acc47bef004e0facc6ee177ca10033 in term 1.
I20260810 06:40:31.154837 30659 leader_election.cc:302] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29acc47bef004e0facc6ee177ca10033, 9bc681e3fd7e4c3da9b699d79408c6fa; no voters:
I20260810 06:40:31.154961 30978 raft_consensus.cc:2781] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:31.155120 30978 raft_consensus.cc:686] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [term 1 LEADER]: Becoming Leader. State: Replica: 29acc47bef004e0facc6ee177ca10033, State: Running, Role: LEADER
I20260810 06:40:31.155169 30978 consensus_queue.cc:237] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.155788 30138 catalog_manager.cc:5495] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29acc47bef004e0facc6ee177ca10033 (127.27.41.131). New cstate: current_term: 1 leader_uuid: "29acc47bef004e0facc6ee177ca10033" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } health_report { overall_health: HEALTHY } } }
I20260810 06:40:31.169137 30983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:31.166864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32890 (local address 127.27.41.131:38251)
0810 06:40:31.167036 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:31.167038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:31.167045 (+ 7us) server_negotiation.cc:407] Connection header received
0810 06:40:31.167064 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:31.167064 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:31.167074 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:31.167129 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:31.167254 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:31.167717 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:31.168437 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:31.168659 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:31.168713 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:31.168836 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:31.168865 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:31.168904 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:31.169033 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 06:40:31.169059 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":109,"threads_started":1}
I20260810 06:40:31.171232 30354 raft_consensus.cc:1261] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Refusing update from remote peer 29acc47bef004e0facc6ee177ca10033: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:31.171393 30548 raft_consensus.cc:1261] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Refusing update from remote peer 29acc47bef004e0facc6ee177ca10033: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:31.171476 30978 consensus_queue.cc:1035] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:31.171576 30979 consensus_queue.cc:1035] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:31.182189 30138 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:31.182302 30138 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:31.183012 30138 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514: Sending DeleteTablet for 3 replicas of tablet 40b2a8392ed6447f9a0d1e58faa4836a
I20260810 06:40:31.183276 30330 tablet_service.cc:1514] Processing DeleteTablet for tablet 40b2a8392ed6447f9a0d1e58faa4836a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:31 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:52702
I20260810 06:40:31.183317 30523 tablet_service.cc:1514] Processing DeleteTablet for tablet 40b2a8392ed6447f9a0d1e58faa4836a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:31 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:59806
I20260810 06:40:31.183368 30726 tablet_service.cc:1514] Processing DeleteTablet for tablet 40b2a8392ed6447f9a0d1e58faa4836a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:31 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:32874
I20260810 06:40:31.183416 30955 tablet_replica.cc:330] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09: stopping tablet replica
I20260810 06:40:31.183465 30957 tablet_replica.cc:330] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033: stopping tablet replica
I20260810 06:40:31.183465 30956 tablet_replica.cc:330] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa: stopping tablet replica
I20260810 06:40:31.183486 30955 raft_consensus.cc:2229] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:31.183516 30956 raft_consensus.cc:2229] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:31.183524 30957 raft_consensus.cc:2229] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:40:31.183532 30955 raft_consensus.cc:2258] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:31.183557 30956 raft_consensus.cc:2258] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:31.183584 30957 raft_consensus.cc:2258] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:31.183768 30138 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47936:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:40:31.183952 30138 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:31.183948 30957 ts_tablet_manager.cc:1905] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:31.184062 30956 ts_tablet_manager.cc:1905] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:31.184192 30955 ts_tablet_manager.cc:1905] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:31.185525 30957 ts_tablet_manager.cc:1918] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:31.185611 30957 log.cc:1196] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/40b2a8392ed6447f9a0d1e58faa4836a
I20260810 06:40:31.185720 30956 ts_tablet_manager.cc:1918] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:31.185720 30955 ts_tablet_manager.cc:1918] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:31.185789 30956 log.cc:1196] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/40b2a8392ed6447f9a0d1e58faa4836a
I20260810 06:40:31.185789 30955 log.cc:1196] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-0/wal/wals/40b2a8392ed6447f9a0d1e58faa4836a
I20260810 06:40:31.185936 30957 ts_tablet_manager.cc:1939] T 40b2a8392ed6447f9a0d1e58faa4836a P 29acc47bef004e0facc6ee177ca10033: Deleting consensus metadata
I20260810 06:40:31.186029 30956 ts_tablet_manager.cc:1939] T 40b2a8392ed6447f9a0d1e58faa4836a P 9bc681e3fd7e4c3da9b699d79408c6fa: Deleting consensus metadata
I20260810 06:40:31.186026 30955 ts_tablet_manager.cc:1939] T 40b2a8392ed6447f9a0d1e58faa4836a P d9e6f52602a041e183511fcd196dcc09: Deleting consensus metadata
I20260810 06:40:31.186349 30121 catalog_manager.cc:4841] TS d9e6f52602a041e183511fcd196dcc09 (127.27.41.129:33631): tablet 40b2a8392ed6447f9a0d1e58faa4836a (table test-table [id=0335f3b4a5d2422890415d31204b8766]) successfully deleted
I20260810 06:40:31.186349 30123 catalog_manager.cc:4841] TS 9bc681e3fd7e4c3da9b699d79408c6fa (127.27.41.130:40991): tablet 40b2a8392ed6447f9a0d1e58faa4836a (table test-table [id=0335f3b4a5d2422890415d31204b8766]) successfully deleted
I20260810 06:40:31.186452 30125 catalog_manager.cc:4841] TS 29acc47bef004e0facc6ee177ca10033 (127.27.41.131:38251): tablet 40b2a8392ed6447f9a0d1e58faa4836a (table test-table [id=0335f3b4a5d2422890415d31204b8766]) successfully deleted
I20260810 06:40:31.187450 30330 tablet_service.cc:1467] Processing CreateTablet for tablet 22f3ae50af144109a634b56a7f5642f6 (DEFAULT_TABLE table=test-table [id=d75667883c66411ebc387a0d41a364b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:31.187459 30726 tablet_service.cc:1467] Processing CreateTablet for tablet 22f3ae50af144109a634b56a7f5642f6 (DEFAULT_TABLE table=test-table [id=d75667883c66411ebc387a0d41a364b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:31.187458 30523 tablet_service.cc:1467] Processing CreateTablet for tablet 22f3ae50af144109a634b56a7f5642f6 (DEFAULT_TABLE table=test-table [id=d75667883c66411ebc387a0d41a364b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:31.187608 30726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22f3ae50af144109a634b56a7f5642f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:31.187608 30523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22f3ae50af144109a634b56a7f5642f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:31.187608 30330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22f3ae50af144109a634b56a7f5642f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:31.188755 30971 tablet_bootstrap.cc:492] T 22f3ae50af144109a634b56a7f5642f6 P d9e6f52602a041e183511fcd196dcc09: Bootstrap starting.
I20260810 06:40:31.188894 30969 tablet_bootstrap.cc:492] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa: Bootstrap starting.
I20260810 06:40:31.188912 30972 tablet_bootstrap.cc:492] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033: Bootstrap starting.
I20260810 06:40:31.189108 30971 tablet_bootstrap.cc:654] T 22f3ae50af144109a634b56a7f5642f6 P d9e6f52602a041e183511fcd196dcc09: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:31.189237 30972 tablet_bootstrap.cc:654] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:31.189244 30969 tablet_bootstrap.cc:654] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:31.189879 30971 tablet_bootstrap.cc:492] T 22f3ae50af144109a634b56a7f5642f6 P d9e6f52602a041e183511fcd196dcc09: No bootstrap required, opened a new log
I20260810 06:40:31.189913 30969 tablet_bootstrap.cc:492] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa: No bootstrap required, opened a new log
I20260810 06:40:31.189929 30972 tablet_bootstrap.cc:492] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033: No bootstrap required, opened a new log
I20260810 06:40:31.189957 30969 ts_tablet_manager.cc:1397] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:31.189957 30971 ts_tablet_manager.cc:1397] T 22f3ae50af144109a634b56a7f5642f6 P d9e6f52602a041e183511fcd196dcc09: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:31.189997 30972 ts_tablet_manager.cc:1397] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:31.190076 30971 raft_consensus.cc:348] T 22f3ae50af144109a634b56a7f5642f6 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.190104 30969 raft_consensus.cc:348] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.190102 30972 raft_consensus.cc:348] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.190160 30971 raft_consensus.cc:374] T 22f3ae50af144109a634b56a7f5642f6 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:31.190169 30969 raft_consensus.cc:374] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:31.190191 30971 raft_consensus.cc:729] T 22f3ae50af144109a634b56a7f5642f6 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9e6f52602a041e183511fcd196dcc09, State: Initialized, Role: FOLLOWER
I20260810 06:40:31.190189 30972 raft_consensus.cc:374] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:31.190196 30969 raft_consensus.cc:729] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc681e3fd7e4c3da9b699d79408c6fa, State: Initialized, Role: FOLLOWER
I20260810 06:40:31.190224 30972 raft_consensus.cc:729] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29acc47bef004e0facc6ee177ca10033, State: Initialized, Role: FOLLOWER
I20260810 06:40:31.190249 30969 consensus_queue.cc:260] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.190246 30971 consensus_queue.cc:260] T 22f3ae50af144109a634b56a7f5642f6 P d9e6f52602a041e183511fcd196dcc09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.190263 30972 consensus_queue.cc:260] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.190344 30971 ts_tablet_manager.cc:1428] T 22f3ae50af144109a634b56a7f5642f6 P d9e6f52602a041e183511fcd196dcc09: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:31.190344 30969 ts_tablet_manager.cc:1428] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:31.190366 30972 ts_tablet_manager.cc:1428] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:31.269448 30944 raft_consensus.cc:482] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:31.269574 30944 raft_consensus.cc:504] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.269814 30944 leader_election.cc:288] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9e6f52602a041e183511fcd196dcc09 (127.27.41.129:33631), 29acc47bef004e0facc6ee177ca10033 (127.27.41.131:38251)
I20260810 06:40:31.270015 30354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22f3ae50af144109a634b56a7f5642f6" candidate_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e6f52602a041e183511fcd196dcc09" is_pre_election: true
I20260810 06:40:31.270045 30755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22f3ae50af144109a634b56a7f5642f6" candidate_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29acc47bef004e0facc6ee177ca10033" is_pre_election: true
I20260810 06:40:31.270138 30755 raft_consensus.cc:2454] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc681e3fd7e4c3da9b699d79408c6fa in term 0.
I20260810 06:40:31.270138 30354 raft_consensus.cc:2454] T 22f3ae50af144109a634b56a7f5642f6 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc681e3fd7e4c3da9b699d79408c6fa in term 0.
I20260810 06:40:31.270299 30456 leader_election.cc:302] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29acc47bef004e0facc6ee177ca10033, 9bc681e3fd7e4c3da9b699d79408c6fa; no voters:
I20260810 06:40:31.270428 30944 raft_consensus.cc:2781] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:31.270495 30944 raft_consensus.cc:482] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:31.270521 30944 raft_consensus.cc:3037] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:31.271638 30944 raft_consensus.cc:504] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.271771 30944 leader_election.cc:288] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [CANDIDATE]: Term 1 election: Requested vote from peers d9e6f52602a041e183511fcd196dcc09 (127.27.41.129:33631), 29acc47bef004e0facc6ee177ca10033 (127.27.41.131:38251)
I20260810 06:40:31.271952 30755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22f3ae50af144109a634b56a7f5642f6" candidate_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29acc47bef004e0facc6ee177ca10033"
I20260810 06:40:31.272025 30755 raft_consensus.cc:3037] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:31.272783 30755 raft_consensus.cc:2454] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc681e3fd7e4c3da9b699d79408c6fa in term 1.
I20260810 06:40:31.272958 30456 leader_election.cc:302] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29acc47bef004e0facc6ee177ca10033, 9bc681e3fd7e4c3da9b699d79408c6fa; no voters:
I20260810 06:40:31.273028 30944 raft_consensus.cc:2781] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:31.273067 30944 raft_consensus.cc:686] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 LEADER]: Becoming Leader. State: Replica: 9bc681e3fd7e4c3da9b699d79408c6fa, State: Running, Role: LEADER
I20260810 06:40:31.273115 30944 consensus_queue.cc:237] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } }
I20260810 06:40:31.273646 30136 catalog_manager.cc:5495] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc681e3fd7e4c3da9b699d79408c6fa (127.27.41.130). New cstate: current_term: 1 leader_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 40991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 } health_report { overall_health: UNKNOWN } } }
I20260810 06:40:31.277439 30354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22f3ae50af144109a634b56a7f5642f6" candidate_uuid: "9bc681e3fd7e4c3da9b699d79408c6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9e6f52602a041e183511fcd196dcc09"
I20260810 06:40:31.277518 30354 raft_consensus.cc:3037] T 22f3ae50af144109a634b56a7f5642f6 P d9e6f52602a041e183511fcd196dcc09 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:31.278144 30354 raft_consensus.cc:2454] T 22f3ae50af144109a634b56a7f5642f6 P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc681e3fd7e4c3da9b699d79408c6fa in term 1.
I20260810 06:40:31.290232 30994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:31.287473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59822 (local address 127.27.41.130:40991)
0810 06:40:31.287649 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:31.287651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:31.287657 (+ 6us) server_negotiation.cc:407] Connection header received
0810 06:40:31.287677 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:31.287677 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:31.287686 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:31.287789 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:31.287942 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:31.288533 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:31.289615 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:31.289901 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:31.289961 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:31.290072 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:31.290099 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:31.290132 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:31.290163 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 06:40:31.290177 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":126,"threads_started":1}
I20260810 06:40:31.292514 30354 raft_consensus.cc:1261] T 22f3ae50af144109a634b56a7f5642f6 P d9e6f52602a041e183511fcd196dcc09 [term 1 FOLLOWER]: Refusing update from remote peer 9bc681e3fd7e4c3da9b699d79408c6fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:31.292528 30755 raft_consensus.cc:1261] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Refusing update from remote peer 9bc681e3fd7e4c3da9b699d79408c6fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:31.292747 30921 consensus_queue.cc:1035] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "29acc47bef004e0facc6ee177ca10033" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:31.292842 30944 consensus_queue.cc:1035] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9e6f52602a041e183511fcd196dcc09" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 06:40:31.297583 30935 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 06:40:32.814875 30137 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:32.814986 30137 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:32.815754 30137 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5bbcc670e07e49ec849b7a178f8e0514: Sending DeleteTablet for 3 replicas of tablet 22f3ae50af144109a634b56a7f5642f6
I20260810 06:40:32.816056 30330 tablet_service.cc:1514] Processing DeleteTablet for tablet 22f3ae50af144109a634b56a7f5642f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:32 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:52702
I20260810 06:40:32.816092 30523 tablet_service.cc:1514] Processing DeleteTablet for tablet 22f3ae50af144109a634b56a7f5642f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:32 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:59806
I20260810 06:40:32.816256 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 30236
I20260810 06:40:32.816290 30726 tablet_service.cc:1514] Processing DeleteTablet for tablet 22f3ae50af144109a634b56a7f5642f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:32 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:32874
I20260810 06:40:32.819777 31033 tablet_replica.cc:330] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033: stopping tablet replica
I20260810 06:40:32.819839 31033 raft_consensus.cc:2229] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:32.819875 31033 raft_consensus.cc:2258] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:32.819968 31032 tablet_replica.cc:330] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa: stopping tablet replica
I20260810 06:40:32.820017 31032 raft_consensus.cc:2229] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:40:32.820070 31032 raft_consensus.cc:2258] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:32.821012 31032 ts_tablet_manager.cc:1905] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:32.822850 31032 ts_tablet_manager.cc:1918] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 06:40:32.822908 31032 log.cc:1196] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/22f3ae50af144109a634b56a7f5642f6
I20260810 06:40:32.823175 31032 ts_tablet_manager.cc:1939] T 22f3ae50af144109a634b56a7f5642f6 P 9bc681e3fd7e4c3da9b699d79408c6fa: Deleting consensus metadata
I20260810 06:40:32.823254 31033 ts_tablet_manager.cc:1905] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:32.823508 30123 catalog_manager.cc:4841] TS 9bc681e3fd7e4c3da9b699d79408c6fa (127.27.41.130:40991): tablet 22f3ae50af144109a634b56a7f5642f6 (table test-table [id=d75667883c66411ebc387a0d41a364b0]) successfully deleted
I20260810 06:40:32.825366 31033 ts_tablet_manager.cc:1918] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 06:40:32.825453 31033 log.cc:1196] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/22f3ae50af144109a634b56a7f5642f6
I20260810 06:40:32.825737 31033 ts_tablet_manager.cc:1939] T 22f3ae50af144109a634b56a7f5642f6 P 29acc47bef004e0facc6ee177ca10033: Deleting consensus metadata
I20260810 06:40:32.826107 30125 catalog_manager.cc:4841] TS 29acc47bef004e0facc6ee177ca10033 (127.27.41.131:38251): tablet 22f3ae50af144109a634b56a7f5642f6 (table test-table [id=d75667883c66411ebc387a0d41a364b0]) successfully deleted
W20260810 06:40:32.833504 30121 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:33631 (error 108)
I20260810 06:40:32.833819 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 30431
I20260810 06:40:32.836943 31037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:32.833914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:33631 (local address 127.0.0.1:60808)
0810 06:40:32.836828 (+ 2914us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:32.836889 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:33631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2882,"thread_start_us":67,"threads_started":1}
W20260810 06:40:32.837230 30121 catalog_manager.cc:4584] TS d9e6f52602a041e183511fcd196dcc09 (127.27.41.129:33631): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 22f3ae50af144109a634b56a7f5642f6: Network error: Client connection negotiation failed: client connection to 127.27.41.129:33631: connect: Connection refused (error 111)
I20260810 06:40:32.845798 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 30628
I20260810 06:40:32.856216 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 30100
2026-08-10T06:40:32Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6048 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:32 dist-test-slave-bw88 krb5kdc[31041](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:32 dist-test-slave-bw88 krb5kdc[31041](info): set up 2 sockets
Aug 10 06:40:32 dist-test-slave-bw88 krb5kdc[31041](info): commencing operation
krb5kdc: starting...
W20260810 06:40:34.045411 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:34 dist-test-slave-bw88 krb5kdc[31041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:40:34.163915 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:33219
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:40303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:33219
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:34.244801 31058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:34.245039 31058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:34.245076 31058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:34.246174 31058 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:34.246253 31058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:34.246275 31058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:34.246295 31058 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:34.246325 31058 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:34.247841 31058 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:40303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:33219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:33219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:34.248117 31058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:34.248353 31058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:34.253629 31066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:34.253626 31069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:34.253659 31058 server_base.cc:1034] running on GCE node
W20260810 06:40:34.253626 31067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:34.254030 31058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:34.254312 31058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:34.255465 31058 hybrid_clock.cc:648] HybridClock initialized: now 1786344034255445 us; error 31 us; skew 500 ppm
Aug 10 06:40:34 dist-test-slave-bw88 krb5kdc[31041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344034, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:34.263127 31058 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:40:34.263664 31058 webserver.cc:460] Webserver started at http://127.27.41.190:42103/ using document root <none> and password file <none>
I20260810 06:40:34.263909 31058 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:34.263963 31058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:34.264151 31058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:34.265270 31058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "2850042e00dd444aa3f63de85ffd6275"
format_stamp: "Formatted at 2026-08-10 06:40:34 on dist-test-slave-bw88"
server_key: "3355986fbcb29d84d46fe0613c93eebd"
server_key_iv: "cf797185c4a79fcc9554ae06d212a784"
server_key_version: "encryptionkey@0"
I20260810 06:40:34.265761 31058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "2850042e00dd444aa3f63de85ffd6275"
format_stamp: "Formatted at 2026-08-10 06:40:34 on dist-test-slave-bw88"
server_key: "3355986fbcb29d84d46fe0613c93eebd"
server_key_iv: "cf797185c4a79fcc9554ae06d212a784"
server_key_version: "encryptionkey@0"
I20260810 06:40:34.267108 31058 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:34.267871 31080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:34.268054 31058 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:34.268144 31058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "2850042e00dd444aa3f63de85ffd6275"
format_stamp: "Formatted at 2026-08-10 06:40:34 on dist-test-slave-bw88"
server_key: "3355986fbcb29d84d46fe0613c93eebd"
server_key_iv: "cf797185c4a79fcc9554ae06d212a784"
server_key_version: "encryptionkey@0"
I20260810 06:40:34.268198 31058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:34.279997 31058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:34.282395 31058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:34.282505 31058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:34.286597 31058 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:33219
I20260810 06:40:34.286652 31147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:33219 every 8 connection(s)
I20260810 06:40:34.286970 31058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:34.287910 31148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:34.288627 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 31058
I20260810 06:40:34.288702 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:34.288887 27814 external_mini_cluster.cc:1428] Setting key 197fb2459698b7aefe45ca4b16b9c497
I20260810 06:40:34.291069 31148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275: Bootstrap starting.
I20260810 06:40:34.291795 31148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:34.292085 31148 log.cc:824] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:34.292797 31148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275: No bootstrap required, opened a new log
I20260810 06:40:34.294989 31148 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2850042e00dd444aa3f63de85ffd6275" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33219 } }
I20260810 06:40:34.295120 31148 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:34.295143 31148 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2850042e00dd444aa3f63de85ffd6275, State: Initialized, Role: FOLLOWER
I20260810 06:40:34.295288 31148 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2850042e00dd444aa3f63de85ffd6275" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33219 } }
I20260810 06:40:34.295362 31148 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:34.295383 31148 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:34.295454 31148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [term 0 FOLLOWER]: Advancing to term 1
Aug 10 06:40:34 dist-test-slave-bw88 krb5kdc[31041](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:34.295938 31148 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2850042e00dd444aa3f63de85ffd6275" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33219 } }
I20260810 06:40:34.296038 31148 leader_election.cc:302] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2850042e00dd444aa3f63de85ffd6275; no voters:
I20260810 06:40:34.296335 31148 leader_election.cc:288] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:34.296360 31156 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:34.296554 31156 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [term 1 LEADER]: Becoming Leader. State: Replica: 2850042e00dd444aa3f63de85ffd6275, State: Running, Role: LEADER
I20260810 06:40:34.296694 31148 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:34.296744 31156 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2850042e00dd444aa3f63de85ffd6275" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33219 } }
I20260810 06:40:34.297156 31156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2850042e00dd444aa3f63de85ffd6275. Latest consensus state: current_term: 1 leader_uuid: "2850042e00dd444aa3f63de85ffd6275" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2850042e00dd444aa3f63de85ffd6275" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33219 } } }
I20260810 06:40:34.297449 31156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:34.297363 31157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2850042e00dd444aa3f63de85ffd6275" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2850042e00dd444aa3f63de85ffd6275" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33219 } } }
I20260810 06:40:34.297874 31157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275 [sys.catalog]: This master's current role is: LEADER
W20260810 06:40:34.298645 31176 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:40:34.298704 31176 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:40:34.298754 31166 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:34.298933 31166 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:34.300645 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:34.289425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54140 (local address 127.27.41.190:33219)
0810 06:40:34.289648 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:34.289658 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:34.289696 (+ 38us) server_negotiation.cc:407] Connection header received
0810 06:40:34.290280 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:34.290289 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:34.290353 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:34.290502 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:34.291094 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.292430 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.293212 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.293896 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.294016 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:34.296514 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:34.296518 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:34.296518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:34.296571 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:34.298713 (+ 2142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:34.299112 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:34.299115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:34.299115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:34.299226 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:34.299462 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:34.299463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:34.299463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:34.299768 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:34.299919 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:34.300341 (+ 422us) server_negotiation.cc:299] Negotiation successful
0810 06:40:34.300479 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":111,"threads_started":1}
I20260810 06:40:34.300776 31166 catalog_manager.cc:1347] Generated new cluster ID: c0ea80b28e90478c8f1c9eb68f87a571
I20260810 06:40:34.300844 31166 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:34.315318 31166 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:34.316510 31166 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:34.323812 31166 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2850042e00dd444aa3f63de85ffd6275: Generated new TSK 0
I20260810 06:40:34.324020 31166 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:40:34.350373 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33219
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:40303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:34.433975 31184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:34.434202 31184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:34.434240 31184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:34.435379 31184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:34.435444 31184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:34.435490 31184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:34.436918 31184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:40303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:34.437165 31184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:34.437426 31184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:34.442567 31191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:34.442611 31196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:34.442616 31193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:34.442901 31184 server_base.cc:1034] running on GCE node
I20260810 06:40:34.443100 31184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:34.443284 31184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:34.444432 31184 hybrid_clock.cc:648] HybridClock initialized: now 1786344034444418 us; error 28 us; skew 500 ppm
Aug 10 06:40:34 dist-test-slave-bw88 krb5kdc[31041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344034, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:34.447008 31184 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:40:34.447503 31184 webserver.cc:460] Webserver started at http://127.27.41.129:38137/ using document root <none> and password file <none>
I20260810 06:40:34.447742 31184 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:34.447809 31184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:34.447960 31184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:34.449023 31184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "bf37a183fa244c4198e50be0de540915"
format_stamp: "Formatted at 2026-08-10 06:40:34 on dist-test-slave-bw88"
server_key: "820d812568344b9851d92c730d4dff19"
server_key_iv: "171324b1728091a85899954401f7f945"
server_key_version: "encryptionkey@0"
I20260810 06:40:34.449455 31184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "bf37a183fa244c4198e50be0de540915"
format_stamp: "Formatted at 2026-08-10 06:40:34 on dist-test-slave-bw88"
server_key: "820d812568344b9851d92c730d4dff19"
server_key_iv: "171324b1728091a85899954401f7f945"
server_key_version: "encryptionkey@0"
I20260810 06:40:34.450891 31184 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:34.451591 31203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:34.451752 31184 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:34.451855 31184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "bf37a183fa244c4198e50be0de540915"
format_stamp: "Formatted at 2026-08-10 06:40:34 on dist-test-slave-bw88"
server_key: "820d812568344b9851d92c730d4dff19"
server_key_iv: "171324b1728091a85899954401f7f945"
server_key_version: "encryptionkey@0"
I20260810 06:40:34.451941 31184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:34.460261 31184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:34.462601 31184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:34.462766 31184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:34.462998 31184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:34.463312 31184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:34.463368 31184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:34.463421 31184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:34.463449 31184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:34.469899 31184 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:46181
I20260810 06:40:34.469952 31353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:46181 every 8 connection(s)
I20260810 06:40:34.470310 31184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:40:34.475697 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 31184
I20260810 06:40:34.475814 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:40:34.476033 27814 external_mini_cluster.cc:1428] Setting key a827ab0f421e61b27bf306592767d533
Aug 10 06:40:34 dist-test-slave-bw88 krb5kdc[31041](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344034, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:34.480252 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:34.471075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:36231 (local address 127.27.41.190:33219)
0810 06:40:34.471121 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:34.471123 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:34.471333 (+ 210us) server_negotiation.cc:407] Connection header received
0810 06:40:34.471876 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:34.471877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:34.471903 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:34.471971 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:34.472872 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.473429 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.474381 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.474579 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.474628 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:34.477288 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:34.477289 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:34.477290 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:34.477296 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:34.478763 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:34.479227 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:34.479228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:34.479229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:34.479291 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:34.479567 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:34.479568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:34.479569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:34.479690 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:34.479768 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:34.480059 (+ 291us) server_negotiation.cc:299] Negotiation successful
0810 06:40:34.480160 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:40:34.480406 31357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:34.471031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:33219 (local address 127.27.41.129:36231)
0810 06:40:34.471195 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:34.471238 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:34.471776 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:34.472033 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:34.472036 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:34.472597 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:34.472788 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:34.472793 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.473513 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.473513 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:34.474308 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:34.474310 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.474650 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.474651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:34.474769 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:34.475252 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:34.475260 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:34.477180 (+ 1920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:34.478890 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:34.478898 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:34.478900 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:34.479134 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:34.479368 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:34.479369 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:34.479369 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:34.479479 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:34.479760 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:34.479768 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:34.479912 (+ 144us) client_negotiation.cc:769] Sending connection context
0810 06:40:34.480016 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 06:40:34.480177 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260810 06:40:34.480865 31354 heartbeater.cc:347] Connected to a master server at 127.27.41.190:33219
I20260810 06:40:34.480959 31354 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:34.481166 31354 heartbeater.cc:511] Master 127.27.41.190:33219 requested a full tablet report, sending...
I20260810 06:40:34.481734 31101 ts_manager.cc:194] Registered new tserver with Master: bf37a183fa244c4198e50be0de540915 (127.27.41.129:46181)
I20260810 06:40:34.482421 31101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:36231
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:40:34.504964 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33219
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:40303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:34.598104 31360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:34.598325 31360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:34.598352 31360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:34.599606 31360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:34.599645 31360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:34.599674 31360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:34.601318 31360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:40303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:34.601593 31360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:34.601785 31360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:34.607636 31367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:34.607647 31370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:34.607643 31368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:34.607916 31360 server_base.cc:1034] running on GCE node
I20260810 06:40:34.608144 31360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:34.608421 31360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:34.609562 31360 hybrid_clock.cc:648] HybridClock initialized: now 1786344034609536 us; error 43 us; skew 500 ppm
Aug 10 06:40:34 dist-test-slave-bw88 krb5kdc[31041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344034, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:34.612165 31360 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:40:34.612609 31360 webserver.cc:460] Webserver started at http://127.27.41.130:43839/ using document root <none> and password file <none>
I20260810 06:40:34.612843 31360 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:34.612911 31360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:34.613075 31360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:34.614217 31360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "913c09dc9a7e4b57ae89a38e4eaf0d5a"
format_stamp: "Formatted at 2026-08-10 06:40:34 on dist-test-slave-bw88"
server_key: "34b359c0d18c9b778514d03925de1a85"
server_key_iv: "52023b7c3481da97a7dfabe92d2930be"
server_key_version: "encryptionkey@0"
I20260810 06:40:34.614598 31360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "913c09dc9a7e4b57ae89a38e4eaf0d5a"
format_stamp: "Formatted at 2026-08-10 06:40:34 on dist-test-slave-bw88"
server_key: "34b359c0d18c9b778514d03925de1a85"
server_key_iv: "52023b7c3481da97a7dfabe92d2930be"
server_key_version: "encryptionkey@0"
I20260810 06:40:34.616058 31360 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 06:40:34.616756 31377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:34.616928 31360 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:34.617043 31360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "913c09dc9a7e4b57ae89a38e4eaf0d5a"
format_stamp: "Formatted at 2026-08-10 06:40:34 on dist-test-slave-bw88"
server_key: "34b359c0d18c9b778514d03925de1a85"
server_key_iv: "52023b7c3481da97a7dfabe92d2930be"
server_key_version: "encryptionkey@0"
I20260810 06:40:34.617117 31360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:34.633435 31360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:34.635869 31360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:34.636058 31360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:34.636323 31360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:34.636659 31360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:34.636715 31360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:34.636751 31360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:34.636809 31360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:34.643018 31360 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:38327
I20260810 06:40:34.643095 31531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:38327 every 8 connection(s)
I20260810 06:40:34.643440 31360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
Aug 10 06:40:34 dist-test-slave-bw88 krb5kdc[31041](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344034, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:34.651120 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 31360
I20260810 06:40:34.651249 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:40:34.651451 27814 external_mini_cluster.cc:1428] Setting key 1e9973eafba6b15daf3efa130ff430af
I20260810 06:40:34.653306 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:34.644268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:56613 (local address 127.27.41.190:33219)
0810 06:40:34.644347 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:34.644350 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:34.644590 (+ 240us) server_negotiation.cc:407] Connection header received
0810 06:40:34.645083 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:34.645084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:34.645093 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:34.645146 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:34.646184 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.646714 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.647695 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.647870 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.647919 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:34.650276 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:34.650278 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:34.650278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:34.650285 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:34.651869 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:34.652321 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:34.652322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:34.652322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:34.652377 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:34.652668 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:34.652668 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:34.652669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:34.652774 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:34.652825 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:34.653176 (+ 351us) server_negotiation.cc:299] Negotiation successful
0810 06:40:34.653242 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 06:40:34.653775 31536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:34.644224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:33219 (local address 127.27.41.130:56613)
0810 06:40:34.644423 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:34.644490 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:34.644995 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:34.645201 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:34.645205 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:34.645877 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:34.646098 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:34.646103 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.646798 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.646799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:34.647616 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:34.647618 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.647945 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.647946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:34.648061 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:34.648620 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:34.648630 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:34.650184 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:34.651951 (+ 1767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:34.651958 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:34.651960 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:34.652239 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:34.652442 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:34.652443 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:34.652444 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:34.652601 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:34.652841 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:34.652848 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:34.653034 (+ 186us) client_negotiation.cc:769] Sending connection context
0810 06:40:34.653155 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 06:40:34.653372 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":102,"threads_started":1}
I20260810 06:40:34.654381 31532 heartbeater.cc:347] Connected to a master server at 127.27.41.190:33219
I20260810 06:40:34.654511 31532 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:34.654716 31532 heartbeater.cc:511] Master 127.27.41.190:33219 requested a full tablet report, sending...
I20260810 06:40:34.655171 31101 ts_manager.cc:194] Registered new tserver with Master: 913c09dc9a7e4b57ae89a38e4eaf0d5a (127.27.41.130:38327)
I20260810 06:40:34.655581 31101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:56613
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:40:34.679674 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33219
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:40303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:34.763926 31543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:34.764125 31543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:34.764147 31543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:34.765355 31543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:34.765427 31543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:34.765484 31543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:34.766882 31543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:40303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:34.767118 31543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:34.767349 31543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:34.772524 31551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:34.772590 31554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:34.772545 31552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:34.772833 31543 server_base.cc:1034] running on GCE node
I20260810 06:40:34.773082 31543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:34.773373 31543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:34.774537 31543 hybrid_clock.cc:648] HybridClock initialized: now 1786344034774524 us; error 29 us; skew 500 ppm
Aug 10 06:40:34 dist-test-slave-bw88 krb5kdc[31041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344034, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:34.777104 31543 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:40:34.777550 31543 webserver.cc:460] Webserver started at http://127.27.41.131:35629/ using document root <none> and password file <none>
I20260810 06:40:34.777730 31543 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:34.777768 31543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:34.777858 31543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:34.778859 31543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "d218404bf9064f059118e8f461df207f"
format_stamp: "Formatted at 2026-08-10 06:40:34 on dist-test-slave-bw88"
server_key: "d050b1142ff53429cc9bc46861fdf201"
server_key_iv: "a7028cc3734058350e47c94a235de483"
server_key_version: "encryptionkey@0"
I20260810 06:40:34.779181 31543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "d218404bf9064f059118e8f461df207f"
format_stamp: "Formatted at 2026-08-10 06:40:34 on dist-test-slave-bw88"
server_key: "d050b1142ff53429cc9bc46861fdf201"
server_key_iv: "a7028cc3734058350e47c94a235de483"
server_key_version: "encryptionkey@0"
I20260810 06:40:34.780462 31543 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:40:34.781152 31563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:34.781332 31543 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:34.781440 31543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "d218404bf9064f059118e8f461df207f"
format_stamp: "Formatted at 2026-08-10 06:40:34 on dist-test-slave-bw88"
server_key: "d050b1142ff53429cc9bc46861fdf201"
server_key_iv: "a7028cc3734058350e47c94a235de483"
server_key_version: "encryptionkey@0"
I20260810 06:40:34.781494 31543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:34.796200 31543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:34.798466 31543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:34.798626 31543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:34.798875 31543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:34.799183 31543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:34.799217 31543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:34.799239 31543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:34.799252 31543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:34.805795 31543 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:45699
I20260810 06:40:34.805835 31717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:45699 every 8 connection(s)
I20260810 06:40:34.806180 31543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
Aug 10 06:40:34 dist-test-slave-bw88 krb5kdc[31041](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344034, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:34.815080 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 31543
I20260810 06:40:34.815189 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:40:34.815377 27814 external_mini_cluster.cc:1428] Setting key fa7a9b3e05df1e03e6b1ee424bd7d82b
I20260810 06:40:34.815766 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:34.806910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:57209 (local address 127.27.41.190:33219)
0810 06:40:34.806965 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:34.806967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:34.807174 (+ 207us) server_negotiation.cc:407] Connection header received
0810 06:40:34.807717 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:34.807718 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:34.807730 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:34.807786 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:34.808718 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.809211 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.810267 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.810470 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.810565 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:34.812693 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:34.812695 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:34.812695 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:34.812703 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:34.814182 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:34.814611 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:34.814612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:34.814613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:34.814674 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:34.814944 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:34.814945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:34.814946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:34.815067 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:34.815141 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:34.815460 (+ 319us) server_negotiation.cc:299] Negotiation successful
0810 06:40:34.815673 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 06:40:34.815968 31720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:34.806890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:33219 (local address 127.27.41.131:57209)
0810 06:40:34.807062 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:34.807096 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:34.807612 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:34.807856 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:34.807860 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:34.808424 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:34.808613 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:34.808618 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.809309 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.809310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:34.810174 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:34.810176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:34.810577 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:34.810578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:34.810713 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:34.811233 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:34.811241 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:34.812597 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:34.814284 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:34.814292 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:34.814294 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:34.814518 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:34.814743 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:34.814744 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:34.814744 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:34.814858 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:34.815144 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:34.815152 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:34.815307 (+ 155us) client_negotiation.cc:769] Sending connection context
0810 06:40:34.815553 (+ 246us) client_negotiation.cc:240] Negotiation successful
0810 06:40:34.815731 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":86,"threads_started":1}
I20260810 06:40:34.816422 31718 heartbeater.cc:347] Connected to a master server at 127.27.41.190:33219
I20260810 06:40:34.816529 31718 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:34.816704 31718 heartbeater.cc:511] Master 127.27.41.190:33219 requested a full tablet report, sending...
I20260810 06:40:34.817080 31100 ts_manager.cc:194] Registered new tserver with Master: d218404bf9064f059118e8f461df207f (127.27.41.131:45699)
I20260810 06:40:34.817551 31100 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:57209
I20260810 06:40:34.827250 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 06:40:34.841753 31152 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:34.840634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54152 (local address 127.27.41.190:33219)
0810 06:40:34.840717 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:34.840719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:34.840826 (+ 107us) server_negotiation.cc:407] Connection header received
0810 06:40:34.840915 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:34.840916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:34.840932 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:34.840998 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:34.841673 (+ 675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54152: BlockingRecv error: recv got EOF from 127.0.0.1:54152 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 06:40:34.842613 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 31184
I20260810 06:40:34.851338 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 31360
I20260810 06:40:34.869932 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 31543
I20260810 06:40:34.876609 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 31058
2026-08-10T06:40:34Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2017 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:34 dist-test-slave-bw88 krb5kdc[31736](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:34 dist-test-slave-bw88 krb5kdc[31736](info): set up 2 sockets
Aug 10 06:40:34 dist-test-slave-bw88 krb5kdc[31736](info): commencing operation
krb5kdc: starting...
W20260810 06:40:36.074476 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:36 dist-test-slave-bw88 krb5kdc[31736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:40:36.196499 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:41807
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:41807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:36.281078 31751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:36.281344 31751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:36.281409 31751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:36.282583 31751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:36.282650 31751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:36.282675 31751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:36.282706 31751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:36.282732 31751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:36.284242 31751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:41807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:41807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:36.284520 31751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:36.284754 31751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:36.289733 31763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:36.289788 31766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:36.289968 31751 server_base.cc:1034] running on GCE node
W20260810 06:40:36.289753 31762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:36.290266 31751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:36.290578 31751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:36.291777 31751 hybrid_clock.cc:648] HybridClock initialized: now 1786344036291769 us; error 34 us; skew 500 ppm
Aug 10 06:40:36 dist-test-slave-bw88 krb5kdc[31736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344036, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:36.294629 31751 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:40:36.295054 31751 webserver.cc:460] Webserver started at http://127.27.41.190:46823/ using document root <none> and password file <none>
I20260810 06:40:36.295270 31751 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:36.295316 31751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:36.295413 31751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:36.296581 31751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "1aca1023a514438c9aab0657c565a9fd"
format_stamp: "Formatted at 2026-08-10 06:40:36 on dist-test-slave-bw88"
server_key: "078bfcd2525b770db574ffba53c3c339"
server_key_iv: "d1c7b644ba72db80aa0e4a2aa2d268e2"
server_key_version: "encryptionkey@0"
I20260810 06:40:36.296952 31751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "1aca1023a514438c9aab0657c565a9fd"
format_stamp: "Formatted at 2026-08-10 06:40:36 on dist-test-slave-bw88"
server_key: "078bfcd2525b770db574ffba53c3c339"
server_key_iv: "d1c7b644ba72db80aa0e4a2aa2d268e2"
server_key_version: "encryptionkey@0"
I20260810 06:40:36.298473 31751 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:40:36.299252 31774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:36.299471 31751 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:36.299580 31751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "1aca1023a514438c9aab0657c565a9fd"
format_stamp: "Formatted at 2026-08-10 06:40:36 on dist-test-slave-bw88"
server_key: "078bfcd2525b770db574ffba53c3c339"
server_key_iv: "d1c7b644ba72db80aa0e4a2aa2d268e2"
server_key_version: "encryptionkey@0"
I20260810 06:40:36.299671 31751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:36.311084 31751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:36.313019 31751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:36.313196 31751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:36.317615 31751 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:41807
I20260810 06:40:36.317680 31845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:41807 every 8 connection(s)
I20260810 06:40:36.318259 31751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:36.319036 31846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:36.321518 31846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd: Bootstrap starting.
I20260810 06:40:36.322134 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 31751
I20260810 06:40:36.322166 31846 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:36.322264 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:36.322458 27814 external_mini_cluster.cc:1428] Setting key 2da1d6f878715d279f5ed59079e9e913
I20260810 06:40:36.322484 31846 log.cc:824] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:36.323377 31846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd: No bootstrap required, opened a new log
I20260810 06:40:36.325485 31846 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca1023a514438c9aab0657c565a9fd" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41807 } }
I20260810 06:40:36.325621 31846 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:36.325644 31846 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1aca1023a514438c9aab0657c565a9fd, State: Initialized, Role: FOLLOWER
I20260810 06:40:36.325784 31846 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca1023a514438c9aab0657c565a9fd" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41807 } }
I20260810 06:40:36.325858 31846 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:36.325881 31846 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:36.325947 31846 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:36.326625 31846 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca1023a514438c9aab0657c565a9fd" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41807 } }
I20260810 06:40:36.326737 31846 leader_election.cc:302] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1aca1023a514438c9aab0657c565a9fd; no voters:
I20260810 06:40:36.326889 31846 leader_election.cc:288] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:36.326968 31852 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:36.327123 31852 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [term 1 LEADER]: Becoming Leader. State: Replica: 1aca1023a514438c9aab0657c565a9fd, State: Running, Role: LEADER
I20260810 06:40:36.327155 31846 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:36.327222 31852 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca1023a514438c9aab0657c565a9fd" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41807 } }
I20260810 06:40:36.327553 31852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1aca1023a514438c9aab0657c565a9fd. Latest consensus state: current_term: 1 leader_uuid: "1aca1023a514438c9aab0657c565a9fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca1023a514438c9aab0657c565a9fd" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41807 } } }
I20260810 06:40:36.327620 31852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:36.327589 31855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1aca1023a514438c9aab0657c565a9fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aca1023a514438c9aab0657c565a9fd" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41807 } } }
I20260810 06:40:36.327687 31855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:36.327867 31860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:36.328433 31860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 06:40:36 dist-test-slave-bw88 krb5kdc[31736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:36.330593 31860 catalog_manager.cc:1347] Generated new cluster ID: 89e5cd7f67f949599e6192720065cfd5
I20260810 06:40:36.330655 31860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:36.334229 31851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:36.322991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44536 (local address 127.27.41.190:41807)
0810 06:40:36.323203 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:36.323213 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:36.323251 (+ 38us) server_negotiation.cc:407] Connection header received
0810 06:40:36.323778 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:36.323786 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:36.323838 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:36.323995 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:36.324721 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:36.325880 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:36.327051 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:36.327758 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:36.327900 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:36.330874 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:36.330878 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:36.330878 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:36.330890 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:36.332614 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:36.332997 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:36.333000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:36.333000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:36.333096 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:36.333309 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:36.333310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:36.333311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:36.333601 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:36.333777 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:36.333871 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 06:40:36.334016 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":111,"threads_started":1}
I20260810 06:40:36.335163 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:40:36.357367 31851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:36.352852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44540 (local address 127.27.41.190:41807)
0810 06:40:36.352895 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:36.352897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:36.353072 (+ 175us) server_negotiation.cc:407] Connection header received
0810 06:40:36.353134 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:36.353135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:36.353149 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:36.353211 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:36.353655 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:36.354528 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:36.355539 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:36.355915 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:36.355998 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:36.356799 (+ 801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:36.356801 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:36.356802 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:36.357069 (+ 267us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:36.357091 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:36.357099 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:36.357170 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:36.357226 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 06:40:36.357255 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:40:36.360981 31860 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:36.361873 31860 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:36.368841 31860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1aca1023a514438c9aab0657c565a9fd: Generated new TSK 0
I20260810 06:40:36.369050 31860 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:40:36.372745 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 31751
2026-08-10T06:40:36Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1500 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:36 dist-test-slave-bw88 krb5kdc[31889](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:36 dist-test-slave-bw88 krb5kdc[31889](info): set up 2 sockets
Aug 10 06:40:36 dist-test-slave-bw88 krb5kdc[31889](info): commencing operation
krb5kdc: starting...
W20260810 06:40:37.600112 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:37 dist-test-slave-bw88 krb5kdc[31889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:40:37.720273 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:44353
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:44075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:44353
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:37.801167 31906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:37.801414 31906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:37.801453 31906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:37.802577 31906 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:37.802618 31906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:37.802631 31906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:37.802644 31906 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:37.802706 31906 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:37.804124 31906 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:44075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:44353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:44353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:37.804369 31906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:37.804630 31906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:37.809598 31916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:37.809635 31912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:37.809794 31911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:37.809810 31906 server_base.cc:1034] running on GCE node
I20260810 06:40:37.810084 31906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:37.810371 31906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:37.811553 31906 hybrid_clock.cc:648] HybridClock initialized: now 1786344037811535 us; error 30 us; skew 500 ppm
Aug 10 06:40:37 dist-test-slave-bw88 krb5kdc[31889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344037, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:37.814164 31906 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:40:37.814617 31906 webserver.cc:460] Webserver started at http://127.27.41.190:37641/ using document root <none> and password file <none>
I20260810 06:40:37.814855 31906 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:37.814925 31906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:37.815085 31906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:37.816095 31906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "7bf4f1f688cc4b69abe447abeca98c60"
format_stamp: "Formatted at 2026-08-10 06:40:37 on dist-test-slave-bw88"
server_key: "3d3c156f1bd5a0ed0529e773d8565f9f"
server_key_iv: "8a68bd938ff67854ba3c68b1751c9725"
server_key_version: "encryptionkey@0"
I20260810 06:40:37.816457 31906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "7bf4f1f688cc4b69abe447abeca98c60"
format_stamp: "Formatted at 2026-08-10 06:40:37 on dist-test-slave-bw88"
server_key: "3d3c156f1bd5a0ed0529e773d8565f9f"
server_key_iv: "8a68bd938ff67854ba3c68b1751c9725"
server_key_version: "encryptionkey@0"
I20260810 06:40:37.817879 31906 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:40:37.818606 31926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:37.818778 31906 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:37.818884 31906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "7bf4f1f688cc4b69abe447abeca98c60"
format_stamp: "Formatted at 2026-08-10 06:40:37 on dist-test-slave-bw88"
server_key: "3d3c156f1bd5a0ed0529e773d8565f9f"
server_key_iv: "8a68bd938ff67854ba3c68b1751c9725"
server_key_version: "encryptionkey@0"
I20260810 06:40:37.818956 31906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:37.827189 31906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:37.829447 31906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:37.829608 31906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:37.833741 31906 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:44353
I20260810 06:40:37.833771 31990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:44353 every 8 connection(s)
I20260810 06:40:37.834122 31906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:37.835110 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 31906
I20260810 06:40:37.835237 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:37.835381 31991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:37.835460 27814 external_mini_cluster.cc:1428] Setting key 17163f4531ff8ac72f03cd59f27c75b5
I20260810 06:40:37.839121 31991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60: Bootstrap starting.
I20260810 06:40:37.839856 31991 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:37.840169 31991 log.cc:824] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:37.841097 31991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60: No bootstrap required, opened a new log
Aug 10 06:40:37 dist-test-slave-bw88 krb5kdc[31889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:37.843397 31991 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bf4f1f688cc4b69abe447abeca98c60" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44353 } }
I20260810 06:40:37.843570 31991 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:37.843622 31991 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf4f1f688cc4b69abe447abeca98c60, State: Initialized, Role: FOLLOWER
I20260810 06:40:37.843771 31991 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bf4f1f688cc4b69abe447abeca98c60" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44353 } }
I20260810 06:40:37.843856 31991 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:37.843902 31991 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:37.843951 31991 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:37.844489 31991 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bf4f1f688cc4b69abe447abeca98c60" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44353 } }
I20260810 06:40:37.844619 31991 leader_election.cc:302] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bf4f1f688cc4b69abe447abeca98c60; no voters:
I20260810 06:40:37.844823 31991 leader_election.cc:288] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:37.844856 31996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:37.844987 31996 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [term 1 LEADER]: Becoming Leader. State: Replica: 7bf4f1f688cc4b69abe447abeca98c60, State: Running, Role: LEADER
I20260810 06:40:37.845124 31991 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:37.845132 31996 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bf4f1f688cc4b69abe447abeca98c60" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44353 } }
I20260810 06:40:37.845765 31999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bf4f1f688cc4b69abe447abeca98c60. Latest consensus state: current_term: 1 leader_uuid: "7bf4f1f688cc4b69abe447abeca98c60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bf4f1f688cc4b69abe447abeca98c60" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44353 } } }
I20260810 06:40:37.845901 31999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:37.846241 32011 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:37.845619 31997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7bf4f1f688cc4b69abe447abeca98c60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bf4f1f688cc4b69abe447abeca98c60" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44353 } } }
I20260810 06:40:37.846642 31997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:37.846923 32011 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:37.847204 31994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:37.836029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36372 (local address 127.27.41.190:44353)
0810 06:40:37.836203 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:37.836211 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:37.836236 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:40:37.836651 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:37.836657 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:37.836703 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:37.836812 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:37.837693 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:37.838587 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:37.839696 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:37.840162 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:37.840281 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:37.843034 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:37.843039 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:37.843039 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:37.843050 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:37.845085 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:37.845532 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:37.845535 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:37.845536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:37.845652 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:37.845873 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:37.845874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:37.845874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:37.846204 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:37.846361 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:37.846848 (+ 487us) server_negotiation.cc:299] Negotiation successful
0810 06:40:37.846991 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
I20260810 06:40:37.848781 32011 catalog_manager.cc:1347] Generated new cluster ID: 33a4056dda674c5c98be1379c8ac89fb
I20260810 06:40:37.848851 32011 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:37.870324 32011 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:37.870914 32011 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:37.873641 32011 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7bf4f1f688cc4b69abe447abeca98c60: Generated new TSK 0
I20260810 06:40:37.873835 32011 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:40:37.904126 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:44353
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:44075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:37.988261 32028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:37.988480 32028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:37.988505 32028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:37.989717 32028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:37.989764 32028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:37.989794 32028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:37.991295 32028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:44075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:44353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:37.991564 32028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:37.991801 32028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:37.997067 32033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:37.997085 32037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:37.997080 32034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:37.997184 32028 server_base.cc:1034] running on GCE node
I20260810 06:40:37.997545 32028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:37.997802 32028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:37.998970 32028 hybrid_clock.cc:648] HybridClock initialized: now 1786344037998953 us; error 27 us; skew 500 ppm
Aug 10 06:40:37 dist-test-slave-bw88 krb5kdc[31889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344037, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:38.001621 32028 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:40:38.002054 32028 webserver.cc:460] Webserver started at http://127.27.41.129:44447/ using document root <none> and password file <none>
I20260810 06:40:38.002293 32028 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:38.002367 32028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:38.002534 32028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:38.003595 32028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "61cb19e848f74438b2dad85fb9cd0af4"
format_stamp: "Formatted at 2026-08-10 06:40:38 on dist-test-slave-bw88"
server_key: "75204e4e1e9b2f23db23cebe3c8379d5"
server_key_iv: "b6f823576a189f0810b7a51baaf9a13a"
server_key_version: "encryptionkey@0"
I20260810 06:40:38.004004 32028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "61cb19e848f74438b2dad85fb9cd0af4"
format_stamp: "Formatted at 2026-08-10 06:40:38 on dist-test-slave-bw88"
server_key: "75204e4e1e9b2f23db23cebe3c8379d5"
server_key_iv: "b6f823576a189f0810b7a51baaf9a13a"
server_key_version: "encryptionkey@0"
I20260810 06:40:38.005465 32028 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:40:38.006316 32044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:38.006488 32028 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:38.006606 32028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "61cb19e848f74438b2dad85fb9cd0af4"
format_stamp: "Formatted at 2026-08-10 06:40:38 on dist-test-slave-bw88"
server_key: "75204e4e1e9b2f23db23cebe3c8379d5"
server_key_iv: "b6f823576a189f0810b7a51baaf9a13a"
server_key_version: "encryptionkey@0"
I20260810 06:40:38.006719 32028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:38.018932 32028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:38.020799 32028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:38.020987 32028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:38.021252 32028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:38.021694 32028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:38.021772 32028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:38.021840 32028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:38.021869 32028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:38.028662 32028 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:42013
I20260810 06:40:38.028743 32189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:42013 every 8 connection(s)
I20260810 06:40:38.029109 32028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:40:38.029278 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 32028
I20260810 06:40:38.029409 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:40:38.029644 27814 external_mini_cluster.cc:1428] Setting key 5f0a646434b10509f109e49416a953ff
Aug 10 06:40:38 dist-test-slave-bw88 krb5kdc[31889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344037, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
I20260810 06:40:38.039951 31994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:38.030072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:32833 (local address 127.27.41.190:44353)
0810 06:40:38.030143 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:38.030145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:38.030344 (+ 199us) server_negotiation.cc:407] Connection header received
0810 06:40:38.030923 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:38.030924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:38.030939 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:38.031012 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:38.032003 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.032522 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.033679 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.033913 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.034006 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:38.036621 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:38.036623 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:38.036624 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:38.036633 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:38.038332 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:38.038829 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:38.038831 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:38.038831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:38.038904 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:38.039190 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:38.039191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:38.039192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:38.039319 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:38.039417 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:38.039725 (+ 308us) server_negotiation.cc:299] Negotiation successful
0810 06:40:38.039846 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 06:40:38.040117 32192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:38.030028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:44353 (local address 127.27.41.129:32833)
0810 06:40:38.030198 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:38.030241 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:38.030807 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:38.031090 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:38.031094 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:38.031681 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:38.031879 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:38.031884 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.032632 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.032633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:38.033562 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:38.033566 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.034020 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.034021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:38.034147 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:38.034752 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:38.034761 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:38.036511 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:38.038452 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:38.038460 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:38.038463 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:38.038701 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:38.038989 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:38.038990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:38.038990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:38.039114 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:38.039405 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:38.039413 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:38.039581 (+ 168us) client_negotiation.cc:769] Sending connection context
0810 06:40:38.039702 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 06:40:38.039867 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
I20260810 06:40:38.040688 32190 heartbeater.cc:347] Connected to a master server at 127.27.41.190:44353
I20260810 06:40:38.040808 32190 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:38.041006 32190 heartbeater.cc:511] Master 127.27.41.190:44353 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
I20260810 06:40:38.041678 31948 ts_manager.cc:194] Registered new tserver with Master: 61cb19e848f74438b2dad85fb9cd0af4 (127.27.41.129:42013)
I20260810 06:40:38.042637 31948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:32833
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:40:38.056604 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:44353
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:44075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:38.139420 32196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:38.139624 32196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:38.139647 32196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:38.140715 32196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:38.140749 32196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:38.140774 32196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:38.142302 32196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:44075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:44353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:38.142508 32196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:38.142678 32196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:38.147862 32202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:38.147874 32203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:38.147874 32205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:38.148128 32196 server_base.cc:1034] running on GCE node
I20260810 06:40:38.148322 32196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:38.148605 32196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:38.149775 32196 hybrid_clock.cc:648] HybridClock initialized: now 1786344038149759 us; error 26 us; skew 500 ppm
Aug 10 06:40:38 dist-test-slave-bw88 krb5kdc[31889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344038, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:38.152189 32196 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:40:38.152639 32196 webserver.cc:460] Webserver started at http://127.27.41.130:38697/ using document root <none> and password file <none>
I20260810 06:40:38.152884 32196 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:38.152954 32196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:38.153115 32196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:38.154237 32196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "74e0110d738049cb92d5ab0c3627b18c"
format_stamp: "Formatted at 2026-08-10 06:40:38 on dist-test-slave-bw88"
server_key: "53bfcd80463a1ee7ae3becfc19772eb3"
server_key_iv: "168fae36e47392cec51f04ab5c0680fb"
server_key_version: "encryptionkey@0"
I20260810 06:40:38.154637 32196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "74e0110d738049cb92d5ab0c3627b18c"
format_stamp: "Formatted at 2026-08-10 06:40:38 on dist-test-slave-bw88"
server_key: "53bfcd80463a1ee7ae3becfc19772eb3"
server_key_iv: "168fae36e47392cec51f04ab5c0680fb"
server_key_version: "encryptionkey@0"
I20260810 06:40:38.156003 32196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 06:40:38.156749 32214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:38.156931 32196 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:38.157038 32196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "74e0110d738049cb92d5ab0c3627b18c"
format_stamp: "Formatted at 2026-08-10 06:40:38 on dist-test-slave-bw88"
server_key: "53bfcd80463a1ee7ae3becfc19772eb3"
server_key_iv: "168fae36e47392cec51f04ab5c0680fb"
server_key_version: "encryptionkey@0"
I20260810 06:40:38.157123 32196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:38.168376 32196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:38.170297 32196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:38.170464 32196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:38.170696 32196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:38.171008 32196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:38.171066 32196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:38.171099 32196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:38.171128 32196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:38.177073 32196 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:41073
I20260810 06:40:38.177134 32364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:41073 every 8 connection(s)
I20260810 06:40:38.177547 32196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:40:38.181890 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 32196
I20260810 06:40:38.182014 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:40:38.182200 27814 external_mini_cluster.cc:1428] Setting key 7995e7aa6c1034cd8411c6d6335d0499
Aug 10 06:40:38 dist-test-slave-bw88 krb5kdc[31889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344038, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:38.188112 31994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:38.178276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:57985 (local address 127.27.41.190:44353)
0810 06:40:38.178363 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:38.178365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:38.178540 (+ 175us) server_negotiation.cc:407] Connection header received
0810 06:40:38.179089 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:38.179090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:38.179102 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:38.179157 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:38.180090 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.180600 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.181640 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.181963 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.182060 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:38.184712 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:38.184714 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:38.184715 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:38.184724 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:38.186447 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:38.186966 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:38.186968 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:38.186968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:38.187039 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:38.187361 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:38.187363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:38.187363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:38.187525 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:38.187619 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:38.187920 (+ 301us) server_negotiation.cc:299] Negotiation successful
0810 06:40:38.188016 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 06:40:38.188316 32367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:38.178229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:44353 (local address 127.27.41.130:57985)
0810 06:40:38.178414 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:38.178452 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:38.178977 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:38.179229 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:38.179233 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:38.179779 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:38.179980 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:38.179984 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.180699 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.180700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:38.181545 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:38.181547 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.182110 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.182112 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:38.182292 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:38.182880 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:38.182890 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:38.184581 (+ 1691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:38.186590 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:38.186598 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:38.186600 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:38.186852 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:38.187120 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:38.187121 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:38.187122 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:38.187274 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:38.187609 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:38.187617 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:38.187776 (+ 159us) client_negotiation.cc:769] Sending connection context
0810 06:40:38.187904 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 06:40:38.188069 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":89,"threads_started":1}
I20260810 06:40:38.188894 32365 heartbeater.cc:347] Connected to a master server at 127.27.41.190:44353
I20260810 06:40:38.188987 32365 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:38.189205 32365 heartbeater.cc:511] Master 127.27.41.190:44353 requested a full tablet report, sending...
I20260810 06:40:38.189699 31948 ts_manager.cc:194] Registered new tserver with Master: 74e0110d738049cb92d5ab0c3627b18c (127.27.41.130:41073)
I20260810 06:40:38.190147 31948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:57985
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:40:38.208031 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:44353
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:44075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:38.289245 32372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:38.289469 32372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:38.289491 32372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:38.290572 32372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:38.290608 32372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:38.290634 32372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:38.291976 32372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:44075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:44353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:38.292150 32372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:38.292304 32372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:38.297266 32378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:38.297293 32380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:38.297263 32377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:38.297554 32372 server_base.cc:1034] running on GCE node
I20260810 06:40:38.297748 32372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:38.297976 32372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:38.299146 32372 hybrid_clock.cc:648] HybridClock initialized: now 1786344038299126 us; error 48 us; skew 500 ppm
Aug 10 06:40:38 dist-test-slave-bw88 krb5kdc[31889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344038, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:38.301721 32372 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:40:38.302273 32372 webserver.cc:460] Webserver started at http://127.27.41.131:36625/ using document root <none> and password file <none>
I20260810 06:40:38.302531 32372 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:38.302575 32372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:38.302790 32372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:38.303834 32372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "b271337ec8fe4769899705b0a7641aab"
format_stamp: "Formatted at 2026-08-10 06:40:38 on dist-test-slave-bw88"
server_key: "e12f2cf5048510e0c2236ccbb998fa57"
server_key_iv: "0f1e4207293fcfe72db25af12c2c7b0b"
server_key_version: "encryptionkey@0"
I20260810 06:40:38.304204 32372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "b271337ec8fe4769899705b0a7641aab"
format_stamp: "Formatted at 2026-08-10 06:40:38 on dist-test-slave-bw88"
server_key: "e12f2cf5048510e0c2236ccbb998fa57"
server_key_iv: "0f1e4207293fcfe72db25af12c2c7b0b"
server_key_version: "encryptionkey@0"
I20260810 06:40:38.305573 32372 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:40:38.306314 32391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:38.306543 32372 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:38.306658 32372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "b271337ec8fe4769899705b0a7641aab"
format_stamp: "Formatted at 2026-08-10 06:40:38 on dist-test-slave-bw88"
server_key: "e12f2cf5048510e0c2236ccbb998fa57"
server_key_iv: "0f1e4207293fcfe72db25af12c2c7b0b"
server_key_version: "encryptionkey@0"
I20260810 06:40:38.306741 32372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:38.323374 32372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:38.325174 32372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:38.325366 32372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:38.325598 32372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:38.325928 32372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:38.325990 32372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:38.326020 32372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:38.326038 32372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:38.332263 32372 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:38635
I20260810 06:40:38.332307 32545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:38635 every 8 connection(s)
I20260810 06:40:38.332610 32372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:40:38.333129 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 32372
I20260810 06:40:38.333230 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:40:38.333467 27814 external_mini_cluster.cc:1428] Setting key cb0506df2eaf3acae80946e193b2d07d
Aug 10 06:40:38 dist-test-slave-bw88 krb5kdc[31889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344038, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:38.342206 31994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:38.333495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:56127 (local address 127.27.41.190:44353)
0810 06:40:38.333555 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:38.333557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:38.333719 (+ 162us) server_negotiation.cc:407] Connection header received
0810 06:40:38.334433 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:38.334434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:38.334446 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:38.334508 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:38.335367 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.335988 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.337013 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.337219 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.337285 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:38.339421 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:38.339422 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:38.339423 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:38.339431 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:38.340863 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:38.341247 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:38.341248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:38.341248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:38.341301 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:38.341665 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:38.341666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:38.341666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:38.341786 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:38.341838 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:38.342074 (+ 236us) server_negotiation.cc:299] Negotiation successful
0810 06:40:38.342141 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 06:40:38.342418 32549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:38.333334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:44353 (local address 127.27.41.131:56127)
0810 06:40:38.333583 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:38.333631 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:38.334309 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:38.334560 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:38.334563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:38.335097 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:38.335276 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:38.335280 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.336101 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.336102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:38.336925 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:38.336927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.337301 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.337302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:38.337483 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:38.337913 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:38.337921 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:38.339324 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:38.340942 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:38.340949 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:38.340950 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:38.341177 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:38.341425 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:38.341426 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:38.341426 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:38.341587 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:38.341842 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:38.341847 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:38.341962 (+ 115us) client_negotiation.cc:769] Sending connection context
0810 06:40:38.342048 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 06:40:38.342169 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":117,"threads_started":1}
I20260810 06:40:38.342948 32546 heartbeater.cc:347] Connected to a master server at 127.27.41.190:44353
I20260810 06:40:38.343041 32546 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:38.343182 32546 heartbeater.cc:511] Master 127.27.41.190:44353 requested a full tablet report, sending...
I20260810 06:40:38.343530 31948 ts_manager.cc:194] Registered new tserver with Master: b271337ec8fe4769899705b0a7641aab (127.27.41.131:38635)
I20260810 06:40:38.343935 31948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:56127
I20260810 06:40:38.345314 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 06:40:38 dist-test-slave-bw88 krb5kdc[31889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344038, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 10 06:40:38 dist-test-slave-bw88 krb5kdc[31889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344038, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:38.369551 31994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:38.362654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36380 (local address 127.27.41.190:44353)
0810 06:40:38.362725 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:38.362727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:38.362836 (+ 109us) server_negotiation.cc:407] Connection header received
0810 06:40:38.362884 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:38.362885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:38.362895 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:38.362955 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:38.363529 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.364023 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.364754 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:38.364934 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:38.364981 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:38.367189 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:38.367190 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:38.367190 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:38.367197 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:38.368598 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:38.368876 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:38.368876 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:38.368877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:38.368928 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:38.369070 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:38.369070 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:38.369070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:38.369203 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:38.369272 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:38.369403 (+ 131us) server_negotiation.cc:299] Negotiation successful
0810 06:40:38.369486 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260810 06:40:38.369803 31948 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:36380
I20260810 06:40:38.370299 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 32028
I20260810 06:40:38.382012 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 32196
I20260810 06:40:38.394510 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 32372
I20260810 06:40:38.401466 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 31906
2026-08-10T06:40:38Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2026 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:38 dist-test-slave-bw88 krb5kdc[32561](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:38 dist-test-slave-bw88 krb5kdc[32561](info): set up 2 sockets
Aug 10 06:40:38 dist-test-slave-bw88 krb5kdc[32561](info): commencing operation
krb5kdc: starting...
W20260810 06:40:39.620749 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:39 dist-test-slave-bw88 krb5kdc[32561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344039, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:40:39.740242 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:33777
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:33777
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:39.826946 32578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:39.827142 32578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:39.827162 32578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:39.828204 32578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:39.828243 32578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:39.828256 32578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:39.828269 32578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:39.828280 32578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:39.829756 32578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:33777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:33777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:39.829953 32578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:39.830129 32578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:39.835330 32587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:39.835387 32578 server_base.cc:1034] running on GCE node
W20260810 06:40:39.835352 32585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:39.835330 32584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:39.835860 32578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:39.836164 32578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:39.837374 32578 hybrid_clock.cc:648] HybridClock initialized: now 1786344039837318 us; error 48 us; skew 500 ppm
Aug 10 06:40:39 dist-test-slave-bw88 krb5kdc[32561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344039, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:39.845073 32578 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:40:39.845664 32578 webserver.cc:460] Webserver started at http://127.27.41.190:41743/ using document root <none> and password file <none>
I20260810 06:40:39.845907 32578 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:39.845983 32578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:39.846127 32578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:39.847231 32578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "6f2721718d134edb834b54b71a110b21"
format_stamp: "Formatted at 2026-08-10 06:40:39 on dist-test-slave-bw88"
server_key: "696cc0643865d4e329e82ecd1f0eb0b0"
server_key_iv: "257368b0837ac67089ec2f97804412ac"
server_key_version: "encryptionkey@0"
I20260810 06:40:39.847625 32578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "6f2721718d134edb834b54b71a110b21"
format_stamp: "Formatted at 2026-08-10 06:40:39 on dist-test-slave-bw88"
server_key: "696cc0643865d4e329e82ecd1f0eb0b0"
server_key_iv: "257368b0837ac67089ec2f97804412ac"
server_key_version: "encryptionkey@0"
I20260810 06:40:39.849012 32578 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:40:39.849825 32599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:39.850004 32578 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:39.850131 32578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "6f2721718d134edb834b54b71a110b21"
format_stamp: "Formatted at 2026-08-10 06:40:39 on dist-test-slave-bw88"
server_key: "696cc0643865d4e329e82ecd1f0eb0b0"
server_key_iv: "257368b0837ac67089ec2f97804412ac"
server_key_version: "encryptionkey@0"
I20260810 06:40:39.850205 32578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:39.858783 32578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:39.860987 32578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:39.861174 32578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:39.865233 32578 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:33777
I20260810 06:40:39.865283 32660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:33777 every 8 connection(s)
I20260810 06:40:39.865829 32578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:39.866498 32661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:39.868795 32661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21: Bootstrap starting.
I20260810 06:40:39.869481 32661 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:39.869798 32661 log.cc:824] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:39.870587 32661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21: No bootstrap required, opened a new log
I20260810 06:40:39.872223 32661 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2721718d134edb834b54b71a110b21" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33777 } }
I20260810 06:40:39.872361 32661 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:39.872385 32661 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f2721718d134edb834b54b71a110b21, State: Initialized, Role: FOLLOWER
I20260810 06:40:39.872558 32661 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2721718d134edb834b54b71a110b21" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33777 } }
I20260810 06:40:39.872622 32661 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:39.872642 32661 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:39.872713 32661 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:39.873661 32661 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2721718d134edb834b54b71a110b21" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33777 } }
I20260810 06:40:39.873775 32661 leader_election.cc:302] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f2721718d134edb834b54b71a110b21; no voters:
I20260810 06:40:39.873950 32661 leader_election.cc:288] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:39.873998 32665 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:39.874173 32665 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [term 1 LEADER]: Becoming Leader. State: Replica: 6f2721718d134edb834b54b71a110b21, State: Running, Role: LEADER
I20260810 06:40:39.874243 32661 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:39.874331 32665 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2721718d134edb834b54b71a110b21" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33777 } }
I20260810 06:40:39.874714 32667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f2721718d134edb834b54b71a110b21. Latest consensus state: current_term: 1 leader_uuid: "6f2721718d134edb834b54b71a110b21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2721718d134edb834b54b71a110b21" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33777 } } }
I20260810 06:40:39.874807 32667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:39.874704 32666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f2721718d134edb834b54b71a110b21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f2721718d134edb834b54b71a110b21" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33777 } } }
I20260810 06:40:39.875267 32666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:39.875048 32676 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:39.875741 32676 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:39.876091 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 32578
I20260810 06:40:39.876221 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:39.876394 27814 external_mini_cluster.cc:1428] Setting key 4346ea4e124ffec903c204e735249a9a
I20260810 06:40:39.878384 32676 catalog_manager.cc:1347] Generated new cluster ID: 819c2b3424bd4d7c8d5236516bf58430
I20260810 06:40:39.878440 32676 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:40:39 dist-test-slave-bw88 krb5kdc[32561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344039, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:39.887748 32689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:39.876859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44770 (local address 127.27.41.190:33777)
0810 06:40:39.877020 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:39.877029 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:39.877063 (+ 34us) server_negotiation.cc:407] Connection header received
0810 06:40:39.877315 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:39.877323 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:39.877404 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:39.877552 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:39.878365 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:39.879752 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:39.880794 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:39.881463 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:39.881535 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:39.884188 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:39.884192 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:39.884192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:39.884203 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:39.886017 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:39.886430 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:39.886433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:39.886433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:39.886530 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:39.886751 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:39.886751 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:39.886752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:39.887067 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:39.887186 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:39.887376 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 06:40:39.887528 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260810 06:40:39.922545 32676 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:39.923113 32676 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:39.931809 32676 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f2721718d134edb834b54b71a110b21: Generated new TSK 0
I20260810 06:40:39.931991 32676 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:40:39.964390 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33777
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:40.047448 32695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:40.047659 32695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:40.047683 32695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:40.048820 32695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:40.048861 32695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:40.048915 32695 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:40.050523 32695 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:40.050781 32695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:40.051003 32695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:40.056128 32701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:40.056454 32702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:40.056504 32706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:40.056494 32695 server_base.cc:1034] running on GCE node
I20260810 06:40:40.056818 32695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:40.057088 32695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:40.058241 32695 hybrid_clock.cc:648] HybridClock initialized: now 1786344040058235 us; error 36 us; skew 500 ppm
Aug 10 06:40:40 dist-test-slave-bw88 krb5kdc[32561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344040, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:40.060992 32695 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:40:40.061523 32695 webserver.cc:460] Webserver started at http://127.27.41.129:42857/ using document root <none> and password file <none>
I20260810 06:40:40.061738 32695 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:40.061781 32695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:40.061869 32695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:40.062860 32695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "311910a650f4437fafb2782001e45571"
format_stamp: "Formatted at 2026-08-10 06:40:40 on dist-test-slave-bw88"
server_key: "f548640b44de728ebce93c6a0d9640b2"
server_key_iv: "183ae08ef0ae64982a583fc37aa38531"
server_key_version: "encryptionkey@0"
I20260810 06:40:40.063170 32695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "311910a650f4437fafb2782001e45571"
format_stamp: "Formatted at 2026-08-10 06:40:40 on dist-test-slave-bw88"
server_key: "f548640b44de728ebce93c6a0d9640b2"
server_key_iv: "183ae08ef0ae64982a583fc37aa38531"
server_key_version: "encryptionkey@0"
I20260810 06:40:40.064438 32695 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:40:40.065109 32713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:40.065281 32695 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:40.065409 32695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "311910a650f4437fafb2782001e45571"
format_stamp: "Formatted at 2026-08-10 06:40:40 on dist-test-slave-bw88"
server_key: "f548640b44de728ebce93c6a0d9640b2"
server_key_iv: "183ae08ef0ae64982a583fc37aa38531"
server_key_version: "encryptionkey@0"
I20260810 06:40:40.065487 32695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:40.081595 32695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:40.084028 32695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:40.084208 32695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:40.084484 32695 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:40.084884 32695 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:40.084955 32695 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:40.085001 32695 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:40.085031 32695 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:40.091141 32695 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:33779
I20260810 06:40:40.091195 389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:33779 every 8 connection(s)
I20260810 06:40:40.091516 32695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
Aug 10 06:40:40 dist-test-slave-bw88 krb5kdc[32561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344040, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:40.100267 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 32695
I20260810 06:40:40.100391 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:40:40.100597 27814 external_mini_cluster.cc:1428] Setting key df624e216ef458a496c3164027bc6a98
I20260810 06:40:40.101186 32689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:40.092364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:33713 (local address 127.27.41.190:33777)
0810 06:40:40.092457 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:40.092459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:40.092631 (+ 172us) server_negotiation.cc:407] Connection header received
0810 06:40:40.093685 (+ 1054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:40.093687 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:40.093703 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:40.093761 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:40.094398 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.094945 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.095972 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.096193 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.096279 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:40.098414 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:40.098416 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:40.098416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:40.098424 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:40.099675 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:40.100089 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:40.100091 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:40.100091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:40.100153 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:40.100431 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:40.100432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:40.100432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:40.100590 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:40.100665 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:40.100974 (+ 309us) server_negotiation.cc:299] Negotiation successful
0810 06:40:40.101078 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 06:40:40.101383 394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:40.092259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:33777 (local address 127.27.41.129:33713)
0810 06:40:40.092486 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:40.092537 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:40.093543 (+ 1006us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:40.093839 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:40.093843 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:40.094088 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:40.094291 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:40.094296 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.095041 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.095042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:40.095874 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:40.095877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.096293 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.096294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:40.096451 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:40.096887 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:40.096895 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:40.098310 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:40.099775 (+ 1465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:40.099782 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:40.099784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:40.100003 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:40.100226 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:40.100226 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:40.100227 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:40.100367 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:40.100656 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:40.100663 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:40.100833 (+ 170us) client_negotiation.cc:769] Sending connection context
0810 06:40:40.100937 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 06:40:40.101097 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":106,"threads_started":1}
I20260810 06:40:40.102090 391 heartbeater.cc:347] Connected to a master server at 127.27.41.190:33777
I20260810 06:40:40.102174 391 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:40.102385 391 heartbeater.cc:511] Master 127.27.41.190:33777 requested a full tablet report, sending...
I20260810 06:40:40.102937 32618 ts_manager.cc:194] Registered new tserver with Master: 311910a650f4437fafb2782001e45571 (127.27.41.129:33779)
I20260810 06:40:40.103847 32618 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:33713
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:40:40.126169 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33777
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:40.208403 398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:40.208600 398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:40.208623 398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:40.209759 398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:40.209798 398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:40.209824 398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:40.211387 398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:40.211616 398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:40.211822 398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:40.217166 407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:40.217193 403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:40.217234 404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:40.217270 398 server_base.cc:1034] running on GCE node
I20260810 06:40:40.217618 398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:40.217866 398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:40.219041 398 hybrid_clock.cc:648] HybridClock initialized: now 1786344040219017 us; error 37 us; skew 500 ppm
Aug 10 06:40:40 dist-test-slave-bw88 krb5kdc[32561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344040, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:40.221802 398 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:40:40.222179 398 webserver.cc:460] Webserver started at http://127.27.41.130:34157/ using document root <none> and password file <none>
I20260810 06:40:40.222388 398 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:40.222426 398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:40.222515 398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:40.223417 398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "e9023cda8afd41f98bd374ed23fbfed8"
format_stamp: "Formatted at 2026-08-10 06:40:40 on dist-test-slave-bw88"
server_key: "8fc959919eb44ec2f44ce0e27b5cd5ca"
server_key_iv: "3a1a70d1bc270a29a52a2c7ee9d5f460"
server_key_version: "encryptionkey@0"
I20260810 06:40:40.223690 398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "e9023cda8afd41f98bd374ed23fbfed8"
format_stamp: "Formatted at 2026-08-10 06:40:40 on dist-test-slave-bw88"
server_key: "8fc959919eb44ec2f44ce0e27b5cd5ca"
server_key_iv: "3a1a70d1bc270a29a52a2c7ee9d5f460"
server_key_version: "encryptionkey@0"
I20260810 06:40:40.224913 398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:40:40.225658 416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:40.225819 398 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 06:40:40.225907 398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "e9023cda8afd41f98bd374ed23fbfed8"
format_stamp: "Formatted at 2026-08-10 06:40:40 on dist-test-slave-bw88"
server_key: "8fc959919eb44ec2f44ce0e27b5cd5ca"
server_key_iv: "3a1a70d1bc270a29a52a2c7ee9d5f460"
server_key_version: "encryptionkey@0"
I20260810 06:40:40.225972 398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:40.237840 398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:40.239846 398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:40.239993 398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:40.240237 398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:40.240549 398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:40.240584 398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:40.240605 398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:40.240651 398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:40.246666 398 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:45209
I20260810 06:40:40.246747 556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:45209 every 8 connection(s)
I20260810 06:40:40.247172 398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:40:40.250993 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 398
I20260810 06:40:40.251107 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:40:40.251282 27814 external_mini_cluster.cc:1428] Setting key a5e373bbb49e64e8de66cac85176ffe0
Aug 10 06:40:40 dist-test-slave-bw88 krb5kdc[32561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344040, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:40.257205 32689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:40.247945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:51281 (local address 127.27.41.190:33777)
0810 06:40:40.247990 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:40.247992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:40.248200 (+ 208us) server_negotiation.cc:407] Connection header received
0810 06:40:40.249132 (+ 932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:40.249132 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:40.249142 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:40.249201 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:40.249808 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.250317 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.251635 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.251872 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.251940 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:40.254402 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:40.254404 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:40.254404 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:40.254411 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:40.255760 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:40.256203 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:40.256205 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:40.256206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:40.256272 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:40.256531 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:40.256532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:40.256533 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:40.256658 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:40.256738 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:40.257011 (+ 273us) server_negotiation.cc:299] Negotiation successful
0810 06:40:40.257116 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:40:40.257424 559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:40.247894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:33777 (local address 127.27.41.130:51281)
0810 06:40:40.248067 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:40.248110 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:40.249042 (+ 932us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:40.249280 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:40.249284 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:40.249547 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:40.249731 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:40.249735 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.250398 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.250398 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:40.251539 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:40.251542 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.251960 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.251961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:40.252105 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:40.252695 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:40.252704 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:40.254302 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:40.255865 (+ 1563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:40.255873 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:40.255875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:40.256109 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:40.256342 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:40.256343 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:40.256344 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:40.256459 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:40.256728 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:40.256735 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:40.256879 (+ 144us) client_negotiation.cc:769] Sending connection context
0810 06:40:40.256990 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 06:40:40.257153 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":103,"threads_started":1}
I20260810 06:40:40.257946 557 heartbeater.cc:347] Connected to a master server at 127.27.41.190:33777
I20260810 06:40:40.258070 557 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:40.258289 557 heartbeater.cc:511] Master 127.27.41.190:33777 requested a full tablet report, sending...
I20260810 06:40:40.258749 32618 ts_manager.cc:194] Registered new tserver with Master: e9023cda8afd41f98bd374ed23fbfed8 (127.27.41.130:45209)
I20260810 06:40:40.259138 32618 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:51281
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:40:40.279183 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33777
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:40.361969 563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:40.362242 563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:40.362272 563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:40.363355 563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:40.363389 563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:40.363415 563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:40.364887 563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:40.365057 563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:40.365227 563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:40.370383 572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:40.370405 571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:40.370642 563 server_base.cc:1034] running on GCE node
W20260810 06:40:40.370689 574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:40.370936 563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:40.371217 563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:40.372368 563 hybrid_clock.cc:648] HybridClock initialized: now 1786344040372360 us; error 29 us; skew 500 ppm
Aug 10 06:40:40 dist-test-slave-bw88 krb5kdc[32561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344040, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:40.375249 563 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:40:40.375769 563 webserver.cc:460] Webserver started at http://127.27.41.131:33601/ using document root <none> and password file <none>
I20260810 06:40:40.376014 563 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:40.376084 563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:40.376235 563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:40.377220 563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "df35f1dd19de4e808d120624047d1051"
format_stamp: "Formatted at 2026-08-10 06:40:40 on dist-test-slave-bw88"
server_key: "ef27a8418f67705bcd7743ad3ced3766"
server_key_iv: "3c2828a767ad397f8e453ab2c25b5af7"
server_key_version: "encryptionkey@0"
I20260810 06:40:40.377650 563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "df35f1dd19de4e808d120624047d1051"
format_stamp: "Formatted at 2026-08-10 06:40:40 on dist-test-slave-bw88"
server_key: "ef27a8418f67705bcd7743ad3ced3766"
server_key_iv: "3c2828a767ad397f8e453ab2c25b5af7"
server_key_version: "encryptionkey@0"
I20260810 06:40:40.378980 563 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:40.379725 583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:40.379922 563 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:40.380003 563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "df35f1dd19de4e808d120624047d1051"
format_stamp: "Formatted at 2026-08-10 06:40:40 on dist-test-slave-bw88"
server_key: "ef27a8418f67705bcd7743ad3ced3766"
server_key_iv: "3c2828a767ad397f8e453ab2c25b5af7"
server_key_version: "encryptionkey@0"
I20260810 06:40:40.380056 563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:40.390342 563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:40.392186 563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:40.392297 563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:40.392472 563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:40.392799 563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:40.392863 563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:40.392920 563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:40.392947 563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:40.399008 563 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:39875
I20260810 06:40:40.399132 739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:39875 every 8 connection(s)
I20260810 06:40:40.399425 563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:40:40.404723 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 563
I20260810 06:40:40.404867 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:40:40.405072 27814 external_mini_cluster.cc:1428] Setting key c50d826ba54d5a71e75d698716c71d4c
Aug 10 06:40:40 dist-test-slave-bw88 krb5kdc[32561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344040, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:40.409478 32689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:40.400223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:47497 (local address 127.27.41.190:33777)
0810 06:40:40.400305 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:40.400308 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:40.400474 (+ 166us) server_negotiation.cc:407] Connection header received
0810 06:40:40.401465 (+ 991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:40.401467 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:40.401480 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:40.401542 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:40.402216 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.402769 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.403768 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.403968 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.404028 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:40.406528 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:40.406529 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:40.406529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:40.406537 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:40.408125 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:40.408684 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:40.408686 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:40.408692 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:40.408761 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:40.408958 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:40.408958 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:40.408959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:40.409058 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:40.409103 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:40.409287 (+ 184us) server_negotiation.cc:299] Negotiation successful
0810 06:40:40.409394 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:40:40.409708 744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:40.400176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:33777 (local address 127.27.41.131:47497)
0810 06:40:40.400352 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:40.400387 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:40.401297 (+ 910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:40.401599 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:40.401602 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:40.401849 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:40.402056 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:40.402060 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.402853 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.402854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:40.403693 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:40.403695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.404053 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.404054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:40.404154 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:40.404636 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:40.404645 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:40.406437 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:40.408226 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:40.408234 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:40.408236 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:40.408538 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:40.408822 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:40.408822 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:40.408822 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:40.408919 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:40.409093 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:40.409096 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:40.409200 (+ 104us) client_negotiation.cc:769] Sending connection context
0810 06:40:40.409274 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 06:40:40.409459 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":104,"threads_started":1}
I20260810 06:40:40.410219 740 heartbeater.cc:347] Connected to a master server at 127.27.41.190:33777
I20260810 06:40:40.410315 740 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:40.410513 740 heartbeater.cc:511] Master 127.27.41.190:33777 requested a full tablet report, sending...
I20260810 06:40:40.410918 32618 ts_manager.cc:194] Registered new tserver with Master: df35f1dd19de4e808d120624047d1051 (127.27.41.131:39875)
I20260810 06:40:40.411302 32618 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:47497
I20260810 06:40:40.417153 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 06:40:40 dist-test-slave-bw88 krb5kdc[32561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 06:40:40 dist-test-slave-bw88 krb5kdc[32561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.129@KRBTEST.COM
I20260810 06:40:40.441798 751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:40.433874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42762 (local address 127.27.41.129:33779)
0810 06:40:40.434053 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:40.434058 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:40.434068 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:40:40.434094 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:40.434096 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:40.434110 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:40.434177 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:40.434914 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.435584 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.436335 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.436655 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.436707 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:40.439073 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:40.439082 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:40.439082 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:40.439089 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:40.440690 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:40.441043 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:40.441045 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:40.441046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:40.441102 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:40.441282 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:40.441283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:40.441283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:40.441473 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:40.441580 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:40.441653 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 06:40:40.441719 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":83,"threads_started":1}
Aug 10 06:40:40 dist-test-slave-bw88 krb5kdc[32561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:40.449677 32689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:40.443096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44780 (local address 127.27.41.190:33777)
0810 06:40:40.443159 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:40.443160 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:40.443168 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:40:40.443211 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:40.443212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:40.443221 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:40.443271 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:40.443742 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.444213 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.444901 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:40.445076 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:40.445125 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:40.447237 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:40.447239 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:40.447239 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:40.447245 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:40.448456 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:40.448848 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:40.448848 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:40.448849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:40.448900 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:40.449080 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:40.449080 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:40.449081 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:40.449219 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:40.449294 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:40.449469 (+ 175us) server_negotiation.cc:299] Negotiation successful
0810 06:40:40.449546 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 06:40:40.449962 32618 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44780
I20260810 06:40:40.450369 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 32695
I20260810 06:40:40.461613 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 398
I20260810 06:40:40.470760 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 563
I20260810 06:40:40.482745 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 32578
2026-08-10T06:40:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2080 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:40 dist-test-slave-bw88 krb5kdc[759](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:40 dist-test-slave-bw88 krb5kdc[759](info): set up 2 sockets
Aug 10 06:40:40 dist-test-slave-bw88 krb5kdc[759](info): commencing operation
krb5kdc: starting...
W20260810 06:40:41.674579 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:41 dist-test-slave-bw88 krb5kdc[759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:40:41.791899 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:35123
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:41313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:35123
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:41.872821 776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:41.873050 776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:41.873090 776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:41.874241 776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:41.874310 776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:41.874334 776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:41.874356 776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:41.874385 776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:41.875906 776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:41313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:35123
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:35123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:41.876185 776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:41.876411 776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:40:41.881289 776 server_base.cc:1034] running on GCE node
W20260810 06:40:41.881371 782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:41.881347 783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:41.881526 785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:41.881778 776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:41.882102 776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:41.883266 776 hybrid_clock.cc:648] HybridClock initialized: now 1786344041883259 us; error 36 us; skew 500 ppm
Aug 10 06:40:41 dist-test-slave-bw88 krb5kdc[759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344041, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:41.885629 776 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:40:41.885996 776 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:41.886067 776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:41.886219 776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:41.887207 776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "3efd6927fc2e4faf84f17ae6d499915a"
format_stamp: "Formatted at 2026-08-10 06:40:41 on dist-test-slave-bw88"
server_key: "763e5f326d2b186223370713f9579ef3"
server_key_iv: "702fefae4b946cf9745685359114e23b"
server_key_version: "encryptionkey@0"
I20260810 06:40:41.887569 776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "3efd6927fc2e4faf84f17ae6d499915a"
format_stamp: "Formatted at 2026-08-10 06:40:41 on dist-test-slave-bw88"
server_key: "763e5f326d2b186223370713f9579ef3"
server_key_iv: "702fefae4b946cf9745685359114e23b"
server_key_version: "encryptionkey@0"
I20260810 06:40:41.888833 776 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:40:41.889542 795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:41.889711 776 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:41.889817 776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "3efd6927fc2e4faf84f17ae6d499915a"
format_stamp: "Formatted at 2026-08-10 06:40:41 on dist-test-slave-bw88"
server_key: "763e5f326d2b186223370713f9579ef3"
server_key_iv: "702fefae4b946cf9745685359114e23b"
server_key_version: "encryptionkey@0"
I20260810 06:40:41.889889 776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:41.898599 776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:41.900343 776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:41.900496 776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:41.904386 776 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:35123
I20260810 06:40:41.904412 863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:35123 every 8 connection(s)
I20260810 06:40:41.904690 776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:41.905797 864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:41.906193 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 776
I20260810 06:40:41.906286 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:41.906488 27814 external_mini_cluster.cc:1428] Setting key 5c14751847013248091d2d39d37db4d9
I20260810 06:40:41.908874 864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a: Bootstrap starting.
I20260810 06:40:41.909595 864 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:41.909896 864 log.cc:824] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:41.910661 864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a: No bootstrap required, opened a new log
I20260810 06:40:41.912652 864 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3efd6927fc2e4faf84f17ae6d499915a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35123 } }
I20260810 06:40:41.912772 864 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:41.912793 864 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3efd6927fc2e4faf84f17ae6d499915a, State: Initialized, Role: FOLLOWER
I20260810 06:40:41.912918 864 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3efd6927fc2e4faf84f17ae6d499915a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35123 } }
I20260810 06:40:41.913017 864 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:41.913043 864 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:41.913115 864 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [term 0 FOLLOWER]: Advancing to term 1
Aug 10 06:40:41 dist-test-slave-bw88 krb5kdc[759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:41.913723 864 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3efd6927fc2e4faf84f17ae6d499915a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35123 } }
I20260810 06:40:41.913839 864 leader_election.cc:302] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3efd6927fc2e4faf84f17ae6d499915a; no voters:
I20260810 06:40:41.913996 864 leader_election.cc:288] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:41.914047 869 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:41.914265 864 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:41.914248 869 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [term 1 LEADER]: Becoming Leader. State: Replica: 3efd6927fc2e4faf84f17ae6d499915a, State: Running, Role: LEADER
I20260810 06:40:41.914644 869 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3efd6927fc2e4faf84f17ae6d499915a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35123 } }
I20260810 06:40:41.915472 871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3efd6927fc2e4faf84f17ae6d499915a. Latest consensus state: current_term: 1 leader_uuid: "3efd6927fc2e4faf84f17ae6d499915a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3efd6927fc2e4faf84f17ae6d499915a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35123 } } }
I20260810 06:40:41.915570 871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:41.915800 873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3efd6927fc2e4faf84f17ae6d499915a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3efd6927fc2e4faf84f17ae6d499915a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35123 } } }
I20260810 06:40:41.916090 873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:41.916247 889 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:41.916786 889 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:41.918236 867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:41.907013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55020 (local address 127.27.41.190:35123)
0810 06:40:41.907221 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:41.907232 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:41.907265 (+ 33us) server_negotiation.cc:407] Connection header received
0810 06:40:41.907805 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:41.907813 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:41.907871 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:41.908019 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:41.908662 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:41.909993 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:41.910921 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:41.911563 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:41.911663 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:41.914005 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:41.914009 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:41.914009 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:41.914021 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:41.916157 (+ 2136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:41.916590 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:41.916593 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:41.916593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:41.916700 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:41.916941 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:41.916942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:41.916943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:41.917229 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:41.917804 (+ 575us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:41.917876 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 06:40:41.918029 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":96,"threads_started":1}
I20260810 06:40:41.918649 889 catalog_manager.cc:1347] Generated new cluster ID: 650e1e0e902842e280fe4fea9c337523
I20260810 06:40:41.918707 889 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:41.928917 889 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:41.929648 889 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:41.935050 889 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a: Generated new TSK 0
I20260810 06:40:41.935218 889 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:40:41.964208 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:35123
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:41313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:42.051853 898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:42.052071 898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:42.052111 898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:42.053207 898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:42.053272 898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:42.053316 898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:42.054816 898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:41313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:35123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:42.055078 898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:42.055343 898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:42.060529 905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:42.060545 908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:42.060557 906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:42.060875 898 server_base.cc:1034] running on GCE node
I20260810 06:40:42.061100 898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:42.061391 898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:42.062546 898 hybrid_clock.cc:648] HybridClock initialized: now 1786344042062522 us; error 39 us; skew 500 ppm
Aug 10 06:40:42 dist-test-slave-bw88 krb5kdc[759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344042, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:42.065075 898 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:40:42.065462 898 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:42.065537 898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:42.065682 898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:42.066668 898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "b2c002452f2545c0bd48b46b4a76c393"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "dbf3d0fd2341d75c6a0f8a0bbe064e72"
server_key_iv: "a55b619be066086e4c9ab185dad6a0ca"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.067040 898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "b2c002452f2545c0bd48b46b4a76c393"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "dbf3d0fd2341d75c6a0f8a0bbe064e72"
server_key_iv: "a55b619be066086e4c9ab185dad6a0ca"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.068341 898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:40:42.069100 916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.069296 898 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:42.069427 898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "b2c002452f2545c0bd48b46b4a76c393"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "dbf3d0fd2341d75c6a0f8a0bbe064e72"
server_key_iv: "a55b619be066086e4c9ab185dad6a0ca"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.069505 898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:42.079978 898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:42.082369 898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:42.082542 898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:42.082772 898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:42.083102 898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:42.083159 898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.083201 898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:42.083231 898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.089278 898 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:33463
I20260810 06:40:42.089385 1070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:33463 every 8 connection(s)
I20260810 06:40:42.089710 898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:40:42.090963 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 898
I20260810 06:40:42.091065 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:40:42.091282 27814 external_mini_cluster.cc:1428] Setting key f1d9fad7096bfd764025a021942c6458
Aug 10 06:40:42 dist-test-slave-bw88 krb5kdc[759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344042, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:42.100870 867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.090462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:53085 (local address 127.27.41.190:35123)
0810 06:40:42.090523 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:42.090525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:42.090708 (+ 183us) server_negotiation.cc:407] Connection header received
0810 06:40:42.091310 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:42.091312 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:42.091328 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:42.091412 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:42.092586 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.093391 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.094558 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.094776 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.094855 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.097482 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:42.097484 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:42.097484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:42.097491 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:42.098994 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:42.099612 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:42.099614 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:42.099614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:42.099687 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:42.100069 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:42.100071 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:42.100071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:42.100248 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:42.100333 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:42.100654 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 06:40:42.100761 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 06:40:42.100890 1073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.090405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:35123 (local address 127.27.41.129:53085)
0810 06:40:42.090578 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:42.090622 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:42.091205 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:42.091525 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:42.091529 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:42.091819 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:42.092491 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.092498 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.093514 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.093515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.094437 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.094440 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.094865 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.094867 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.095000 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.095556 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:42.095566 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:42.097375 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:42.099159 (+ 1784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:42.099168 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:42.099170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:42.099523 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:42.099762 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:42.099763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:42.099764 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:42.099921 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:42.100353 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:42.100360 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:42.100494 (+ 134us) client_negotiation.cc:769] Sending connection context
0810 06:40:42.100589 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 06:40:42.100721 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":99,"threads_started":1}
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
I20260810 06:40:42.101658 1071 heartbeater.cc:347] Connected to a master server at 127.27.41.190:35123
I20260810 06:40:42.101779 1071 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:42.101943 1071 heartbeater.cc:511] Master 127.27.41.190:35123 requested a full tablet report, sending...
I20260810 06:40:42.102492 814 ts_manager.cc:194] Registered new tserver with Master: b2c002452f2545c0bd48b46b4a76c393 (127.27.41.129:33463)
I20260810 06:40:42.103062 814 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:53085
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:40:42.119997 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:35123
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:41313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:42.202615 1077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:42.202867 1077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:42.202908 1077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:42.204036 1077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:42.204116 1077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:42.204169 1077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:42.205672 1077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:41313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:35123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:42.205932 1077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:42.206156 1077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:42.211180 1084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:42.211182 1087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:42.211182 1091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:42.211537 1077 server_base.cc:1034] running on GCE node
I20260810 06:40:42.211812 1077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:42.212083 1077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:42.213260 1077 hybrid_clock.cc:648] HybridClock initialized: now 1786344042213242 us; error 29 us; skew 500 ppm
Aug 10 06:40:42 dist-test-slave-bw88 krb5kdc[759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344042, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:42.216156 1077 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:40:42.216490 1077 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:42.216566 1077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:42.216729 1077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:42.217837 1077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "6d4714b96fc24956a1076d41acbb4ee8"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "a2e3c0a8849b7bba74a534b652df49bb"
server_key_iv: "3497cb6371e61f046806fff8ffd3e131"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.218221 1077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "6d4714b96fc24956a1076d41acbb4ee8"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "a2e3c0a8849b7bba74a534b652df49bb"
server_key_iv: "3497cb6371e61f046806fff8ffd3e131"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.219553 1077 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:40:42.220293 1101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.220479 1077 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:42.220592 1077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "6d4714b96fc24956a1076d41acbb4ee8"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "a2e3c0a8849b7bba74a534b652df49bb"
server_key_iv: "3497cb6371e61f046806fff8ffd3e131"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.220671 1077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:42.228559 1077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:42.231022 1077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:42.231191 1077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:42.231506 1077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:42.231842 1077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:42.231917 1077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.231962 1077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:42.231993 1077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.238394 1077 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:45549
I20260810 06:40:42.238464 1251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:45549 every 8 connection(s)
I20260810 06:40:42.238737 1077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
Aug 10 06:40:42 dist-test-slave-bw88 krb5kdc[759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344042, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:42.245483 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 1077
I20260810 06:40:42.245594 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:40:42.245790 27814 external_mini_cluster.cc:1428] Setting key 88c9ea82aeb151905e8f1e9c78f56391
I20260810 06:40:42.248342 867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.239463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:38661 (local address 127.27.41.190:35123)
0810 06:40:42.239511 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:42.239512 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:42.239752 (+ 240us) server_negotiation.cc:407] Connection header received
0810 06:40:42.240216 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:42.240217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:42.240228 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:42.240290 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:42.241192 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.241779 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.242808 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.243006 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.243070 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.245248 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:42.245249 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:42.245250 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:42.245257 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:42.246911 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:42.247405 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:42.247406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:42.247406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:42.247459 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:42.247744 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:42.247745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:42.247745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:42.247846 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:42.247895 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:42.248216 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 06:40:42.248282 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:40:42.248625 1254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.239433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:35123 (local address 127.27.41.130:38661)
0810 06:40:42.239614 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:42.239654 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:42.240125 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:42.240340 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:42.240342 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:42.240592 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:42.241065 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.241070 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.241888 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.241894 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.242719 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.242721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.243135 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.243136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.243243 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.243792 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:42.243800 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:42.245136 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:42.247003 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:42.247011 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:42.247013 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:42.247330 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:42.247531 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:42.247532 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:42.247533 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:42.247676 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:42.247909 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:42.247915 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:42.248081 (+ 166us) client_negotiation.cc:769] Sending connection context
0810 06:40:42.248191 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 06:40:42.248368 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
I20260810 06:40:42.249112 1252 heartbeater.cc:347] Connected to a master server at 127.27.41.190:35123
I20260810 06:40:42.249220 1252 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:42.249398 1252 heartbeater.cc:511] Master 127.27.41.190:35123 requested a full tablet report, sending...
I20260810 06:40:42.249802 814 ts_manager.cc:194] Registered new tserver with Master: 6d4714b96fc24956a1076d41acbb4ee8 (127.27.41.130:45549)
I20260810 06:40:42.250222 814 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:38661
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:40:42.272190 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:35123
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:41313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:42.353757 1259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:42.353946 1259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:42.353969 1259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:42.355002 1259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:42.355043 1259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:42.355067 1259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:42.356453 1259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:41313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:35123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:42.356627 1259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:42.356781 1259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:42.361671 1266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:42.361649 1265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:42.361662 1268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:42.362073 1259 server_base.cc:1034] running on GCE node
I20260810 06:40:42.362231 1259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:42.362406 1259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:42.363544 1259 hybrid_clock.cc:648] HybridClock initialized: now 1786344042363531 us; error 29 us; skew 500 ppm
Aug 10 06:40:42 dist-test-slave-bw88 krb5kdc[759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344042, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:42.365922 1259 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:40:42.366317 1259 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:42.366394 1259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:42.366554 1259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:42.367520 1259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "779365b865d44d6ba229b58cc55b79b6"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "3a577796dd1e64b08ae23cd11b6b6dba"
server_key_iv: "68a6d96630a100649553f5e813fca976"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.367884 1259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "779365b865d44d6ba229b58cc55b79b6"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "3a577796dd1e64b08ae23cd11b6b6dba"
server_key_iv: "68a6d96630a100649553f5e813fca976"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.369117 1259 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:40:42.369825 1276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.369988 1259 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.370088 1259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "779365b865d44d6ba229b58cc55b79b6"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "3a577796dd1e64b08ae23cd11b6b6dba"
server_key_iv: "68a6d96630a100649553f5e813fca976"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.370165 1259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:42.381932 1259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:42.383647 1259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:42.383806 1259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:42.384028 1259 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:42.384341 1259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:42.384395 1259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.384433 1259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:42.384460 1259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.390560 1259 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:44117
I20260810 06:40:42.390633 1430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:44117 every 8 connection(s)
I20260810 06:40:42.390888 1259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
Aug 10 06:40:42 dist-test-slave-bw88 krb5kdc[759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344042, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:42.397050 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 1259
I20260810 06:40:42.397171 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:40:42.397420 27814 external_mini_cluster.cc:1428] Setting key 107d5dbcf7344e9aa0c816fb31414790
I20260810 06:40:42.400280 867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.391605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:34499 (local address 127.27.41.190:35123)
0810 06:40:42.391673 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:42.391676 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:42.391877 (+ 201us) server_negotiation.cc:407] Connection header received
0810 06:40:42.392403 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:42.392404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:42.392414 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:42.392466 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:42.393448 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.393942 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.394877 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.395064 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.395113 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.397273 (+ 2160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:42.397275 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:42.397276 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:42.397289 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:42.398886 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:42.399304 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:42.399305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:42.399306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:42.399385 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:42.399634 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:42.399635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:42.399636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:42.399756 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:42.399828 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:42.400103 (+ 275us) server_negotiation.cc:299] Negotiation successful
0810 06:40:42.400182 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 06:40:42.400451 1433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.391591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:35123 (local address 127.27.41.131:34499)
0810 06:40:42.391763 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:42.391797 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:42.392318 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:42.392516 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:42.392519 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:42.392811 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:42.393324 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.393330 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.394021 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.394022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.394806 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.394808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.395133 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.395134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.395228 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.395732 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:42.395741 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:42.397127 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:42.398979 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:42.398986 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:42.398987 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:42.399217 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:42.399454 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:42.399455 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:42.399455 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:42.399561 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:42.399831 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:42.399839 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:42.399960 (+ 121us) client_negotiation.cc:769] Sending connection context
0810 06:40:42.400080 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 06:40:42.400228 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":92,"threads_started":1}
I20260810 06:40:42.400903 1431 heartbeater.cc:347] Connected to a master server at 127.27.41.190:35123
I20260810 06:40:42.400981 1431 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:42.401160 1431 heartbeater.cc:511] Master 127.27.41.190:35123 requested a full tablet report, sending...
I20260810 06:40:42.401587 814 ts_manager.cc:194] Registered new tserver with Master: 779365b865d44d6ba229b58cc55b79b6 (127.27.41.131:44117)
I20260810 06:40:42.401980 814 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:34499
I20260810 06:40:42.409015 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:40:42.417703 867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.410496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40190 (local address 127.27.41.190:35123)
0810 06:40:42.410553 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:42.410555 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:42.410698 (+ 143us) server_negotiation.cc:407] Connection header received
0810 06:40:42.410735 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:42.410736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:42.410745 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:42.410794 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:42.411330 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.411794 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.412451 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.412627 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.412684 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.414325 (+ 1641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:42.414326 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:42.414327 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:42.414333 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:42.416478 (+ 2145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:42.416836 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:42.416837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:42.416838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:42.416897 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:42.417108 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:42.417109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:42.417109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:42.417252 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:42.417396 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:42.417526 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 06:40:42.417609 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 06:40:42.419127 814 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40190:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:40:42.420607 814 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:42.427201 1452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.423070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:45549 (local address 127.0.0.1:53796)
0810 06:40:42.423386 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:42.423396 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:42.423457 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:42.423693 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:42.423696 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:42.423698 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:42.423766 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.423768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.425185 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.425186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.426176 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.426179 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.426914 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.426915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.426989 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.427003 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 06:40:42.427077 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 06:40:42.427128 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"mutex_wait_us":75,"thread_start_us":48,"threads_started":1}
I20260810 06:40:42.427213 1453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.423204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53796 (local address 127.27.41.130:45549)
0810 06:40:42.423362 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:42.423367 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:42.423444 (+ 77us) server_negotiation.cc:407] Connection header received
0810 06:40:42.423539 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:42.423541 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:42.423557 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:42.423633 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:42.423898 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.425051 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.426265 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.426828 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.426915 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.426978 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:42.427095 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 06:40:42.427138 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":84,"threads_started":1}
I20260810 06:40:42.427302 1451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.422972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47574 (local address 127.27.41.131:44117)
0810 06:40:42.423183 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:42.423187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:42.423283 (+ 96us) server_negotiation.cc:407] Connection header received
0810 06:40:42.423600 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:42.423603 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:42.423621 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:42.423694 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:42.423960 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.424738 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.426156 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.426857 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.426924 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.426976 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:42.427173 (+ 197us) server_negotiation.cc:299] Negotiation successful
0810 06:40:42.427222 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":97,"threads_started":1}
I20260810 06:40:42.427573 1447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.422850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:33463 (local address 127.0.0.1:35042)
0810 06:40:42.423320 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:42.423328 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:42.423405 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:42.423823 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:42.423824 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:42.423825 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:42.423866 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.423867 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.425187 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.425188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.426406 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.426409 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.427336 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.427337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.427402 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.427406 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:42.427457 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 06:40:42.427484 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"mutex_wait_us":96,"thread_start_us":64,"threads_started":1}
I20260810 06:40:42.427577 1444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.422850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:44117 (local address 127.0.0.1:47574)
0810 06:40:42.423173 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:42.423218 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:42.423484 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:42.423803 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:42.423804 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:42.423807 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:42.423866 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.423867 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.424834 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.424834 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.426062 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.426065 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.427013 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.427014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.427077 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.427081 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:42.427437 (+ 356us) client_negotiation.cc:240] Negotiation successful
0810 06:40:42.427484 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":65,"threads_started":1}
I20260810 06:40:42.427820 1449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.422991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35042 (local address 127.27.41.129:33463)
0810 06:40:42.423263 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:42.423267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:42.423641 (+ 374us) server_negotiation.cc:407] Connection header received
0810 06:40:42.423714 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:42.423716 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:42.423732 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:42.423819 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:42.423936 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.425076 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.426490 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.427197 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.427254 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.427302 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:42.427686 (+ 384us) server_negotiation.cc:299] Negotiation successful
0810 06:40:42.427733 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":83,"threads_started":1}
I20260810 06:40:42.428222 1170 tablet_service.cc:1467] Processing CreateTablet for tablet 15715ce7f4ba45c3a547de110e0a9e0b (DEFAULT_TABLE table=test-table [id=3c202776727f4920aedebeb6c7ec26a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:42.428419 982 tablet_service.cc:1467] Processing CreateTablet for tablet 15715ce7f4ba45c3a547de110e0a9e0b (DEFAULT_TABLE table=test-table [id=3c202776727f4920aedebeb6c7ec26a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:42.428422 1342 tablet_service.cc:1467] Processing CreateTablet for tablet 15715ce7f4ba45c3a547de110e0a9e0b (DEFAULT_TABLE table=test-table [id=3c202776727f4920aedebeb6c7ec26a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:42.428615 1170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15715ce7f4ba45c3a547de110e0a9e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:42.428758 1342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15715ce7f4ba45c3a547de110e0a9e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:42.428758 982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15715ce7f4ba45c3a547de110e0a9e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:42.431664 1454 tablet_bootstrap.cc:492] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8: Bootstrap starting.
I20260810 06:40:42.432207 1455 tablet_bootstrap.cc:492] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6: Bootstrap starting.
I20260810 06:40:42.432439 1456 tablet_bootstrap.cc:492] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393: Bootstrap starting.
I20260810 06:40:42.432570 1454 tablet_bootstrap.cc:654] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:42.432899 1455 tablet_bootstrap.cc:654] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:42.433113 1456 tablet_bootstrap.cc:654] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:42.433313 1454 log.cc:824] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:42.433656 1455 log.cc:824] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:42.433847 1456 log.cc:824] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:42.434512 1454 tablet_bootstrap.cc:492] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8: No bootstrap required, opened a new log
I20260810 06:40:42.434571 1454 ts_tablet_manager.cc:1397] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260810 06:40:42.436389 1454 raft_consensus.cc:348] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2c002452f2545c0bd48b46b4a76c393" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33463 } } peers { permanent_uuid: "779365b865d44d6ba229b58cc55b79b6" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44117 } } peers { permanent_uuid: "6d4714b96fc24956a1076d41acbb4ee8" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 45549 } }
I20260810 06:40:42.436546 1454 raft_consensus.cc:374] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:42.436576 1454 raft_consensus.cc:729] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4714b96fc24956a1076d41acbb4ee8, State: Initialized, Role: FOLLOWER
I20260810 06:40:42.436678 1454 consensus_queue.cc:260] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2c002452f2545c0bd48b46b4a76c393" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33463 } } peers { permanent_uuid: "779365b865d44d6ba229b58cc55b79b6" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44117 } } peers { permanent_uuid: "6d4714b96fc24956a1076d41acbb4ee8" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 45549 } }
I20260810 06:40:42.436916 1454 ts_tablet_manager.cc:1428] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 06:40:42.440490 1252 heartbeater.cc:503] Master 127.27.41.190:35123 was elected leader, sending a full tablet report...
I20260810 06:40:42.440768 1456 tablet_bootstrap.cc:492] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393: No bootstrap required, opened a new log
I20260810 06:40:42.440827 1456 ts_tablet_manager.cc:1397] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260810 06:40:42.441082 1455 tablet_bootstrap.cc:492] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6: No bootstrap required, opened a new log
I20260810 06:40:42.441167 1455 ts_tablet_manager.cc:1397] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260810 06:40:42.443100 1456 raft_consensus.cc:348] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2c002452f2545c0bd48b46b4a76c393" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33463 } } peers { permanent_uuid: "779365b865d44d6ba229b58cc55b79b6" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44117 } } peers { permanent_uuid: "6d4714b96fc24956a1076d41acbb4ee8" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 45549 } }
I20260810 06:40:42.443140 1455 raft_consensus.cc:348] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2c002452f2545c0bd48b46b4a76c393" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33463 } } peers { permanent_uuid: "779365b865d44d6ba229b58cc55b79b6" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44117 } } peers { permanent_uuid: "6d4714b96fc24956a1076d41acbb4ee8" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 45549 } }
I20260810 06:40:42.443272 1456 raft_consensus.cc:374] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:42.443277 1455 raft_consensus.cc:374] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:42.443324 1455 raft_consensus.cc:729] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 779365b865d44d6ba229b58cc55b79b6, State: Initialized, Role: FOLLOWER
I20260810 06:40:42.443325 1456 raft_consensus.cc:729] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2c002452f2545c0bd48b46b4a76c393, State: Initialized, Role: FOLLOWER
I20260810 06:40:42.443444 1456 consensus_queue.cc:260] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2c002452f2545c0bd48b46b4a76c393" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33463 } } peers { permanent_uuid: "779365b865d44d6ba229b58cc55b79b6" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44117 } } peers { permanent_uuid: "6d4714b96fc24956a1076d41acbb4ee8" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 45549 } }
I20260810 06:40:42.443444 1455 consensus_queue.cc:260] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2c002452f2545c0bd48b46b4a76c393" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33463 } } peers { permanent_uuid: "779365b865d44d6ba229b58cc55b79b6" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44117 } } peers { permanent_uuid: "6d4714b96fc24956a1076d41acbb4ee8" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 45549 } }
I20260810 06:40:42.443742 1455 ts_tablet_manager.cc:1428] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:40:42.443783 1456 ts_tablet_manager.cc:1428] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:40:42.443825 1071 heartbeater.cc:503] Master 127.27.41.190:35123 was elected leader, sending a full tablet report...
I20260810 06:40:42.443897 1431 heartbeater.cc:503] Master 127.27.41.190:35123 was elected leader, sending a full tablet report...
W20260810 06:40:42.489360 1253 tablet.cc:2369] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:40:42.590569 1072 tablet.cc:2369] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:40:42.599781 1462 raft_consensus.cc:482] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:42.599915 1462 raft_consensus.cc:504] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2c002452f2545c0bd48b46b4a76c393" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33463 } } peers { permanent_uuid: "779365b865d44d6ba229b58cc55b79b6" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44117 } } peers { permanent_uuid: "6d4714b96fc24956a1076d41acbb4ee8" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 45549 } }
I20260810 06:40:42.600405 1462 leader_election.cc:288] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2c002452f2545c0bd48b46b4a76c393 (127.27.41.129:33463), 779365b865d44d6ba229b58cc55b79b6 (127.27.41.131:44117)
I20260810 06:40:42.604329 1449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.600684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:44923 (local address 127.27.41.129:33463)
0810 06:40:42.600733 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:42.600735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:42.600749 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:40:42.600807 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:42.600808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:42.600819 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:42.600872 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:42.601079 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.601875 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.603366 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.603914 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.604007 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.604019 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:42.604219 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 06:40:42.604258 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 06:40:42.604329 1451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.600773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:47845 (local address 127.27.41.131:44117)
0810 06:40:42.600819 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:42.600821 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:42.600940 (+ 119us) server_negotiation.cc:407] Connection header received
0810 06:40:42.600979 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:42.600980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:42.600988 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:42.601057 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:42.601264 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.601978 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.603367 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.603971 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.604036 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.604045 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:42.604216 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 06:40:42.604259 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:40:42.604346 1254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.600612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:33463 (local address 127.27.41.130:44923)
0810 06:40:42.600667 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:42.600681 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:42.600736 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:42.600895 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:42.600896 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:42.600897 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:42.600978 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.600980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.601956 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.601957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.603254 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.603257 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.604000 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.604017 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.604128 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.604134 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:40:42.604194 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 06:40:42.604249 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":75}
I20260810 06:40:42.604351 1465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.600671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:44117 (local address 127.27.41.130:47845)
0810 06:40:42.600856 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:42.600866 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:42.600930 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:42.601078 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:42.601079 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:42.601081 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:42.601182 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.601184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.602056 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.602057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.603254 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:42.603257 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.604044 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.604045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:42.604128 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.604134 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:40:42.604194 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 06:40:42.604249 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":14,"thread_start_us":104,"threads_started":1}
I20260810 06:40:42.604858 1004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15715ce7f4ba45c3a547de110e0a9e0b" candidate_uuid: "6d4714b96fc24956a1076d41acbb4ee8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c002452f2545c0bd48b46b4a76c393" is_pre_election: true
I20260810 06:40:42.604928 1364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15715ce7f4ba45c3a547de110e0a9e0b" candidate_uuid: "6d4714b96fc24956a1076d41acbb4ee8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "779365b865d44d6ba229b58cc55b79b6" is_pre_election: true
I20260810 06:40:42.605036 1004 raft_consensus.cc:2454] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4714b96fc24956a1076d41acbb4ee8 in term 0.
I20260810 06:40:42.605099 1364 raft_consensus.cc:2454] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4714b96fc24956a1076d41acbb4ee8 in term 0.
I20260810 06:40:42.605291 1104 leader_election.cc:302] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4714b96fc24956a1076d41acbb4ee8, b2c002452f2545c0bd48b46b4a76c393; no voters:
I20260810 06:40:42.605480 1462 raft_consensus.cc:2781] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:42.605553 1462 raft_consensus.cc:482] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:42.605582 1462 raft_consensus.cc:3037] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:42.606333 1462 raft_consensus.cc:504] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2c002452f2545c0bd48b46b4a76c393" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33463 } } peers { permanent_uuid: "779365b865d44d6ba229b58cc55b79b6" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44117 } } peers { permanent_uuid: "6d4714b96fc24956a1076d41acbb4ee8" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 45549 } }
I20260810 06:40:42.606487 1462 leader_election.cc:288] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [CANDIDATE]: Term 1 election: Requested vote from peers b2c002452f2545c0bd48b46b4a76c393 (127.27.41.129:33463), 779365b865d44d6ba229b58cc55b79b6 (127.27.41.131:44117)
I20260810 06:40:42.606665 1004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15715ce7f4ba45c3a547de110e0a9e0b" candidate_uuid: "6d4714b96fc24956a1076d41acbb4ee8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c002452f2545c0bd48b46b4a76c393"
I20260810 06:40:42.606758 1004 raft_consensus.cc:3037] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:42.607576 1004 raft_consensus.cc:2454] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4714b96fc24956a1076d41acbb4ee8 in term 1.
I20260810 06:40:42.607718 1364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15715ce7f4ba45c3a547de110e0a9e0b" candidate_uuid: "6d4714b96fc24956a1076d41acbb4ee8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "779365b865d44d6ba229b58cc55b79b6"
I20260810 06:40:42.607762 1104 leader_election.cc:302] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4714b96fc24956a1076d41acbb4ee8, b2c002452f2545c0bd48b46b4a76c393; no voters:
I20260810 06:40:42.607810 1364 raft_consensus.cc:3037] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:42.607887 1462 raft_consensus.cc:2781] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:42.608055 1462 raft_consensus.cc:686] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [term 1 LEADER]: Becoming Leader. State: Replica: 6d4714b96fc24956a1076d41acbb4ee8, State: Running, Role: LEADER
I20260810 06:40:42.608163 1462 consensus_queue.cc:237] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2c002452f2545c0bd48b46b4a76c393" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33463 } } peers { permanent_uuid: "779365b865d44d6ba229b58cc55b79b6" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44117 } } peers { permanent_uuid: "6d4714b96fc24956a1076d41acbb4ee8" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 45549 } }
I20260810 06:40:42.608754 1364 raft_consensus.cc:2454] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4714b96fc24956a1076d41acbb4ee8 in term 1.
I20260810 06:40:42.609371 813 catalog_manager.cc:5495] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4714b96fc24956a1076d41acbb4ee8 (127.27.41.130). New cstate: current_term: 1 leader_uuid: "6d4714b96fc24956a1076d41acbb4ee8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2c002452f2545c0bd48b46b4a76c393" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "779365b865d44d6ba229b58cc55b79b6" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4714b96fc24956a1076d41acbb4ee8" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 45549 } health_report { overall_health: HEALTHY } } }
W20260810 06:40:42.641463 1432 tablet.cc:2369] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:40:42.655050 1453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.652495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53806 (local address 127.27.41.130:45549)
0810 06:40:42.652543 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:42.652546 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:42.652555 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:42.652647 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:42.652648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:42.652673 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:42.652753 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:42.652916 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.653444 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.654233 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:42.654442 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:42.654516 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:42.654697 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:42.654799 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:42.654892 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:42.654912 (+ 20us) server_negotiation.cc:299] Negotiation successful
0810 06:40:42.654933 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 06:40:42.656906 1004 raft_consensus.cc:1261] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393 [term 1 FOLLOWER]: Refusing update from remote peer 6d4714b96fc24956a1076d41acbb4ee8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:42.656948 1364 raft_consensus.cc:1261] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6 [term 1 FOLLOWER]: Refusing update from remote peer 6d4714b96fc24956a1076d41acbb4ee8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:42.657387 1462 consensus_queue.cc:1035] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "779365b865d44d6ba229b58cc55b79b6" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:42.657570 1466 consensus_queue.cc:1035] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c002452f2545c0bd48b46b4a76c393" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 33463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:42.659916 1469 mvcc.cc:205] Tried to move back new op lower bound from 7316865198719819776 to 7316865198523584512. Current Snapshot: MvccSnapshot[applied={T|T < 7316865198719819776}]
I20260810 06:40:42.660092 1472 mvcc.cc:205] Tried to move back new op lower bound from 7316865198719819776 to 7316865198523584512. Current Snapshot: MvccSnapshot[applied={T|T < 7316865198719819776}]
I20260810 06:40:42.660197 1470 mvcc.cc:205] Tried to move back new op lower bound from 7316865198719819776 to 7316865198523584512. Current Snapshot: MvccSnapshot[applied={T|T < 7316865198719819776}]
I20260810 06:40:42.662200 814 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:42.662302 814 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40190:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:42.663130 814 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3efd6927fc2e4faf84f17ae6d499915a: Sending DeleteTablet for 3 replicas of tablet 15715ce7f4ba45c3a547de110e0a9e0b
I20260810 06:40:42.663491 982 tablet_service.cc:1514] Processing DeleteTablet for tablet 15715ce7f4ba45c3a547de110e0a9e0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:42 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:35042
I20260810 06:40:42.663658 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 898
I20260810 06:40:42.663774 1482 tablet_replica.cc:330] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393: stopping tablet replica
I20260810 06:40:42.663858 1170 tablet_service.cc:1514] Processing DeleteTablet for tablet 15715ce7f4ba45c3a547de110e0a9e0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:42 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:53796
I20260810 06:40:42.663918 1482 raft_consensus.cc:2229] T 15715ce7f4ba45c3a547de110e0a9e0b P b2c002452f2545c0bd48b46b4a76c393 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:42.664253 1342 tablet_service.cc:1514] Processing DeleteTablet for tablet 15715ce7f4ba45c3a547de110e0a9e0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:42 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:47574
I20260810 06:40:42.666286 1484 tablet_replica.cc:330] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6: stopping tablet replica
I20260810 06:40:42.666389 1484 raft_consensus.cc:2229] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:42.666481 1484 raft_consensus.cc:2258] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:42.668109 1484 ts_tablet_manager.cc:1905] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:42.669967 1484 ts_tablet_manager.cc:1918] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:42.670073 1484 log.cc:1196] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/15715ce7f4ba45c3a547de110e0a9e0b
I20260810 06:40:42.670373 1484 ts_tablet_manager.cc:1939] T 15715ce7f4ba45c3a547de110e0a9e0b P 779365b865d44d6ba229b58cc55b79b6: Deleting consensus metadata
I20260810 06:40:42.670815 797 catalog_manager.cc:4841] TS 779365b865d44d6ba229b58cc55b79b6 (127.27.41.131:44117): tablet 15715ce7f4ba45c3a547de110e0a9e0b (table test-table [id=3c202776727f4920aedebeb6c7ec26a7]) successfully deleted
I20260810 06:40:42.673462 1483 tablet_replica.cc:330] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8: stopping tablet replica
I20260810 06:40:42.673576 1483 raft_consensus.cc:2229] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:40:42.673709 1483 raft_consensus.cc:2258] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:42.674253 1483 ts_tablet_manager.cc:1905] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:42.676332 1483 ts_tablet_manager.cc:1918] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:42.676409 1483 log.cc:1196] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/15715ce7f4ba45c3a547de110e0a9e0b
W20260810 06:40:42.676564 798 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:33463 (error 108)
I20260810 06:40:42.676717 1483 ts_tablet_manager.cc:1939] T 15715ce7f4ba45c3a547de110e0a9e0b P 6d4714b96fc24956a1076d41acbb4ee8: Deleting consensus metadata
I20260810 06:40:42.676862 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 1077
I20260810 06:40:42.678802 1444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.678394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:33463 (local address 127.0.0.1:35058)
0810 06:40:42.678737 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:42.678774 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:33463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324}
W20260810 06:40:42.678990 798 catalog_manager.cc:4584] TS b2c002452f2545c0bd48b46b4a76c393 (127.27.41.129:33463): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 15715ce7f4ba45c3a547de110e0a9e0b: Network error: Client connection negotiation failed: client connection to 127.27.41.129:33463: connect: Connection refused (error 111)
I20260810 06:40:42.684948 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 1259
I20260810 06:40:42.684971 1444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.684847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:45549 (local address 127.0.0.1:53818)
0810 06:40:42.684906 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:42.684937 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.130:45549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 06:40:42.694173 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 776
2026-08-10T06:40:42Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2210 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-10T06:40:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:42Z Disabled control of system clock
I20260810 06:40:42.726626 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38017
--webserver_interface=127.27.41.190
--webserver_port=0
--builtin_ntp_servers=127.27.41.148:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:38017
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 06:40:42.808429 1490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:42.808633 1490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:42.808655 1490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:42.809790 1490 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:42.809832 1490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:42.809845 1490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:42.809857 1490 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:42.809908 1490 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:42.811327 1490 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:38017
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:42.811596 1490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:42.811875 1490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:42.816712 1497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:42.816768 1496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:42.816764 1500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:42.816814 1490 server_base.cc:1034] running on GCE node
I20260810 06:40:42.817155 1490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:42.817508 1490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:42.818698 1490 hybrid_clock.cc:648] HybridClock initialized: now 1786344042818685 us; error 45 us; skew 500 ppm
I20260810 06:40:42.820001 1490 webserver.cc:460] Webserver started at http://127.27.41.190:37091/ using document root <none> and password file <none>
I20260810 06:40:42.820241 1490 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:42.820317 1490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:42.820502 1490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:42.821689 1490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "ccd33840b13f432fbef115c76253248a"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "3e8395b48b6e47ba076be396ee86cedf"
server_key_iv: "61035e494c101cc789e7bd4c28ae3b90"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.822062 1490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "ccd33840b13f432fbef115c76253248a"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "3e8395b48b6e47ba076be396ee86cedf"
server_key_iv: "61035e494c101cc789e7bd4c28ae3b90"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.823377 1490 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:42.824090 1507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.824261 1490 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:42.824373 1490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "ccd33840b13f432fbef115c76253248a"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "3e8395b48b6e47ba076be396ee86cedf"
server_key_iv: "61035e494c101cc789e7bd4c28ae3b90"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.824453 1490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:42.827755 1490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:42.828011 1490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:42.828163 1490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:42.832211 1490 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:38017
I20260810 06:40:42.832238 1576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:38017 every 8 connection(s)
I20260810 06:40:42.832546 1490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:42.833237 1581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:42.835765 1581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a: Bootstrap starting.
I20260810 06:40:42.836334 1581 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:42.836679 1581 log.cc:824] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:42.837424 1581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a: No bootstrap required, opened a new log
I20260810 06:40:42.838956 1581 raft_consensus.cc:348] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccd33840b13f432fbef115c76253248a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38017 } }
I20260810 06:40:42.839082 1581 raft_consensus.cc:374] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:42.839104 1581 raft_consensus.cc:729] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd33840b13f432fbef115c76253248a, State: Initialized, Role: FOLLOWER
I20260810 06:40:42.839282 1581 consensus_queue.cc:260] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccd33840b13f432fbef115c76253248a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38017 } }
I20260810 06:40:42.839361 1581 raft_consensus.cc:388] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:42.839411 1581 raft_consensus.cc:482] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:42.839457 1581 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:42.839985 1581 raft_consensus.cc:504] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccd33840b13f432fbef115c76253248a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38017 } }
I20260810 06:40:42.840098 1581 leader_election.cc:302] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ccd33840b13f432fbef115c76253248a; no voters:
I20260810 06:40:42.840273 1581 leader_election.cc:288] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:42.840327 1584 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:42.840524 1581 sys_catalog.cc:564] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:42.840543 1584 raft_consensus.cc:686] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [term 1 LEADER]: Becoming Leader. State: Replica: ccd33840b13f432fbef115c76253248a, State: Running, Role: LEADER
I20260810 06:40:42.840740 1584 consensus_queue.cc:237] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccd33840b13f432fbef115c76253248a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38017 } }
I20260810 06:40:42.841179 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 1490
I20260810 06:40:42.841291 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:42.841456 1586 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ccd33840b13f432fbef115c76253248a. Latest consensus state: current_term: 1 leader_uuid: "ccd33840b13f432fbef115c76253248a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccd33840b13f432fbef115c76253248a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38017 } } }
I20260810 06:40:42.841542 27814 external_mini_cluster.cc:1428] Setting key 14a9bf9ea1446d902d41c9bcc4ace4f5
I20260810 06:40:42.841564 1586 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:42.841857 1593 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:42.842310 1585 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ccd33840b13f432fbef115c76253248a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccd33840b13f432fbef115c76253248a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38017 } } }
I20260810 06:40:42.842617 1585 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:42.842790 1593 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:42.844308 1607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.842207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43756 (local address 127.27.41.190:38017)
0810 06:40:42.842643 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:42.842651 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:42.842684 (+ 33us) server_negotiation.cc:407] Connection header received
0810 06:40:42.842827 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:42.842834 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:42.842879 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:42.843033 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:42.843681 (+ 648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:42.843684 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:42.843685 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:42.843689 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:42.843756 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:42.843772 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:42.843840 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:42.843945 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 06:40:42.844110 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":96,"threads_started":1}
I20260810 06:40:42.844769 1593 catalog_manager.cc:1347] Generated new cluster ID: d688ce216fe84e46aa355537c28bbc5e
I20260810 06:40:42.844841 1593 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:42.851754 1593 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:42.851904 1593 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:42.858081 1593 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a: Generated new TSK 0
I20260810 06:40:42.858283 1593 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:40:42.863364 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38017
--builtin_ntp_servers=127.27.41.148:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 06:40:42.946926 1613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:42.947160 1613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:42.947202 1613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:42.948367 1613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:42.948434 1613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:42.948479 1613 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:42.949922 1613 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:42.950186 1613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:42.950488 1613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:42.956326 1621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:42.956363 1622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:42.956413 1626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:42.956681 1613 server_base.cc:1034] running on GCE node
I20260810 06:40:42.956900 1613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:42.957150 1613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:42.958315 1613 hybrid_clock.cc:648] HybridClock initialized: now 1786344042958286 us; error 47 us; skew 500 ppm
I20260810 06:40:42.959645 1613 webserver.cc:460] Webserver started at http://127.27.41.129:45171/ using document root <none> and password file <none>
I20260810 06:40:42.959896 1613 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:42.959969 1613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:42.960143 1613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:42.961247 1613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "11153782f8f742e593da5eede5919165"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "403cb358a0d524a27c0827ef37872e42"
server_key_iv: "df859658e2bc34e0ec6c77119dc5ae7d"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.961709 1613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "11153782f8f742e593da5eede5919165"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "403cb358a0d524a27c0827ef37872e42"
server_key_iv: "df859658e2bc34e0ec6c77119dc5ae7d"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.963093 1613 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:42.963881 1635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.964040 1613 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:42.964160 1613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "11153782f8f742e593da5eede5919165"
format_stamp: "Formatted at 2026-08-10 06:40:42 on dist-test-slave-bw88"
server_key: "403cb358a0d524a27c0827ef37872e42"
server_key_iv: "df859658e2bc34e0ec6c77119dc5ae7d"
server_key_version: "encryptionkey@0"
I20260810 06:40:42.964239 1613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:42.967592 1613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:42.967876 1613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:42.968014 1613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:42.968269 1613 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:42.968658 1613 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:42.968715 1613 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.968760 1613 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:42.968786 1613 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:42.974785 1613 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:38199
I20260810 06:40:42.974840 1791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:38199 every 8 connection(s)
I20260810 06:40:42.975143 1613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:40:42.977911 1607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.975807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:47399 (local address 127.27.41.190:38017)
0810 06:40:42.975876 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:42.975879 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:42.976137 (+ 258us) server_negotiation.cc:407] Connection header received
0810 06:40:42.976561 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:42.976562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:42.976568 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:42.976631 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:42.977706 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:42.977707 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:42.977707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:42.977711 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:42.977726 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:42.977730 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:42.977787 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:42.977846 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 06:40:42.977860 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 06:40:42.978138 1798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:42.975808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38017 (local address 127.27.41.129:47399)
0810 06:40:42.976017 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:42.976055 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:42.976481 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:42.976681 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:42.976684 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:42.976691 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:42.977567 (+ 876us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:40:42.977568 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:42.977595 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:40:42.977623 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:42.977786 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:42.977788 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:42.977790 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:40:42.977841 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 06:40:42.977886 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":100,"threads_started":1}
I20260810 06:40:42.978678 1795 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38017
I20260810 06:40:42.978807 1795 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:42.978958 1795 heartbeater.cc:511] Master 127.27.41.190:38017 requested a full tablet report, sending...
I20260810 06:40:42.978986 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 1613
I20260810 06:40:42.979103 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:40:42.979321 27814 external_mini_cluster.cc:1428] Setting key 6a1699728aff0e8856220dc51dad0468
I20260810 06:40:42.979641 1529 ts_manager.cc:194] Registered new tserver with Master: 11153782f8f742e593da5eede5919165 (127.27.41.129:38199)
I20260810 06:40:42.980391 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38017
--builtin_ntp_servers=127.27.41.148:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 06:40:43.065151 1799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:43.065418 1799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:43.065474 1799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:43.066735 1799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:43.066774 1799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:43.066800 1799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:43.068244 1799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:43.068485 1799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:43.068781 1799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:43.073997 1804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:43.074021 1807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:43.074293 1799 server_base.cc:1034] running on GCE node
W20260810 06:40:43.074045 1805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:43.074599 1799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:43.074870 1799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:43.076040 1799 hybrid_clock.cc:648] HybridClock initialized: now 1786344043076028 us; error 29 us; skew 500 ppm
I20260810 06:40:43.077415 1799 webserver.cc:460] Webserver started at http://127.27.41.130:43883/ using document root <none> and password file <none>
I20260810 06:40:43.077682 1799 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:43.077754 1799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:43.077920 1799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:43.079046 1799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "365a7f03f45943728d70ddf50957e140"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "ada66e2180f5d1d2b9b9a0e6727c529a"
server_key_iv: "807c3eaa612f522d8d165352b4bc8a68"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.079445 1799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "365a7f03f45943728d70ddf50957e140"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "ada66e2180f5d1d2b9b9a0e6727c529a"
server_key_iv: "807c3eaa612f522d8d165352b4bc8a68"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.080811 1799 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:40:43.081633 1815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:43.081797 1799 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:43.081909 1799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "365a7f03f45943728d70ddf50957e140"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "ada66e2180f5d1d2b9b9a0e6727c529a"
server_key_iv: "807c3eaa612f522d8d165352b4bc8a68"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.081986 1799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:43.085642 1799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:43.085933 1799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:43.086086 1799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:43.086308 1799 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:43.086676 1799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:43.086737 1799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:43.086779 1799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:43.086807 1799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:43.094206 1799 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:35733
I20260810 06:40:43.094241 1964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:35733 every 8 connection(s)
I20260810 06:40:43.094831 1799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:40:43.095702 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 1799
I20260810 06:40:43.095816 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:40:43.096043 27814 external_mini_cluster.cc:1428] Setting key 878c440baadffbf893938acc585678b0
I20260810 06:40:43.097150 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38017
--builtin_ntp_servers=127.27.41.148:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 06:40:43.098537 1607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.095772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:54951 (local address 127.27.41.190:38017)
0810 06:40:43.095837 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.095839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.096148 (+ 309us) server_negotiation.cc:407] Connection header received
0810 06:40:43.096850 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.096851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.096857 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.096920 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:43.098181 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:43.098183 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:43.098184 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:43.098190 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:43.098210 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:43.098216 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:43.098283 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:43.098419 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 06:40:43.098434 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 06:40:43.098724 1969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.095730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38017 (local address 127.27.41.130:54951)
0810 06:40:43.095995 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:43.096031 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:43.096691 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:43.096986 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:43.096989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:43.096997 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:43.098015 (+ 1018us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:40:43.098016 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:43.098046 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:40:43.098077 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:43.098318 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:43.098326 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:43.098329 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:43.098412 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 06:40:43.098466 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":102,"threads_started":1}
I20260810 06:40:43.099260 1966 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38017
I20260810 06:40:43.099372 1966 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:43.099529 1966 heartbeater.cc:511] Master 127.27.41.190:38017 requested a full tablet report, sending...
I20260810 06:40:43.099908 1528 ts_manager.cc:194] Registered new tserver with Master: 365a7f03f45943728d70ddf50957e140 (127.27.41.130:35733)
W20260810 06:40:43.181896 1970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:43.182088 1970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:43.182111 1970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:43.183194 1970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:43.183228 1970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:43.183254 1970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:43.184515 1970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:43.184728 1970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:43.185002 1970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:43.190084 1978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:43.190078 1975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:43.190095 1970 server_base.cc:1034] running on GCE node
W20260810 06:40:43.190078 1976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:43.190665 1970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:43.190932 1970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:43.192098 1970 hybrid_clock.cc:648] HybridClock initialized: now 1786344043192085 us; error 30 us; skew 500 ppm
I20260810 06:40:43.193251 1970 webserver.cc:460] Webserver started at http://127.27.41.131:39131/ using document root <none> and password file <none>
I20260810 06:40:43.193524 1970 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:43.193600 1970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:43.193739 1970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:43.194790 1970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "ef309bbb5ac147018c2437134e7a1d58"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "0c52960c05ddef12c84825de90629f5c"
server_key_iv: "f9b88153ff8acf0def895a89861a923d"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.195176 1970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "ef309bbb5ac147018c2437134e7a1d58"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "0c52960c05ddef12c84825de90629f5c"
server_key_iv: "f9b88153ff8acf0def895a89861a923d"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.196507 1970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:40:43.197229 1991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:43.197417 1970 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:43.197520 1970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "ef309bbb5ac147018c2437134e7a1d58"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "0c52960c05ddef12c84825de90629f5c"
server_key_iv: "f9b88153ff8acf0def895a89861a923d"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.197602 1970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:43.200814 1970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:43.201085 1970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:43.201251 1970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:43.201501 1970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:43.201814 1970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:43.201870 1970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:43.201917 1970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:43.201944 1970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:43.207995 1970 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:35215
I20260810 06:40:43.208034 2150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:35215 every 8 connection(s)
I20260810 06:40:43.208340 1970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:40:43.211385 1607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.209040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:39591 (local address 127.27.41.190:38017)
0810 06:40:43.209082 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.209084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.209314 (+ 230us) server_negotiation.cc:407] Connection header received
0810 06:40:43.209875 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.209876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.209883 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.209947 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:43.211122 (+ 1175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:43.211124 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:43.211124 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:43.211129 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:43.211144 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:43.211148 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:43.211198 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:43.211298 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 06:40:43.211315 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 06:40:43.211629 2153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.209018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38017 (local address 127.27.41.131:39591)
0810 06:40:43.209205 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:43.209233 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:43.209755 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:43.210015 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:43.210019 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:43.210028 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:43.210970 (+ 942us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:40:43.210971 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:43.210997 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:40:43.211023 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:43.211205 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:43.211211 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:43.211214 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:43.211307 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 06:40:43.211365 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":84,"threads_started":1}
I20260810 06:40:43.212083 2151 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38017
I20260810 06:40:43.212172 2151 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:43.212276 2151 heartbeater.cc:511] Master 127.27.41.190:38017 requested a full tablet report, sending...
I20260810 06:40:43.212610 1528 ts_manager.cc:194] Registered new tserver with Master: ef309bbb5ac147018c2437134e7a1d58 (127.27.41.131:35215)
I20260810 06:40:43.213469 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 1970
I20260810 06:40:43.213565 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:40:43.213722 27814 external_mini_cluster.cc:1428] Setting key 2678bc262ff7c538e2620ff4ba48b576
I20260810 06:40:43.214632 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:40:43.216856 1607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.215876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43762 (local address 127.27.41.190:38017)
0810 06:40:43.215910 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.215912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.216073 (+ 161us) server_negotiation.cc:407] Connection header received
0810 06:40:43.216098 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.216099 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.216104 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.216155 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:43.216645 (+ 490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:43.216646 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:43.216646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:43.216650 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:43.216663 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:43.216667 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:43.216705 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:43.216739 (+ 34us) server_negotiation.cc:299] Negotiation successful
0810 06:40:43.216751 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 06:40:43.218315 1528 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43762:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:40:43.219779 1528 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:43.223616 2161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.222077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:38199 (local address 127.0.0.1:58226)
0810 06:40:43.222247 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:43.222284 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:43.222338 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:43.222530 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:43.222537 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:43.222555 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:43.223117 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:40:43.223118 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:43.223133 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:40:43.223154 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:43.223427 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:43.223460 (+ 33us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:43.223464 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:43.223539 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 06:40:43.223554 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":71,"threads_started":1}
I20260810 06:40:43.223716 2163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.222174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36180 (local address 127.27.41.131:35215)
0810 06:40:43.222529 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.222533 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.222553 (+ 20us) server_negotiation.cc:407] Connection header received
0810 06:40:43.222573 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.222574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.222581 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.222644 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:43.223392 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:43.223399 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:43.223400 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:43.223403 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:43.223435 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:43.223473 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:43.223565 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:43.223621 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 06:40:43.223637 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":88,"threads_started":1}
I20260810 06:40:43.223892 2164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.222194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58226 (local address 127.27.41.129:38199)
0810 06:40:43.222381 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.222385 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.222395 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:40:43.222423 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.222425 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.222436 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.222513 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:43.223239 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:43.223251 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:43.223251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:43.223256 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:43.223292 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:43.223318 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:43.223409 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:43.223786 (+ 377us) server_negotiation.cc:299] Negotiation successful
0810 06:40:43.223804 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":75,"threads_started":1}
I20260810 06:40:43.223709 2162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.222079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:35215 (local address 127.0.0.1:36180)
0810 06:40:43.222347 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:43.222359 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:43.222413 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:43.222886 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:43.222887 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:43.222889 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:43.223284 (+ 395us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:40:43.223285 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:43.223292 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:40:43.223305 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:43.223562 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:43.223563 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:43.223564 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 06:40:43.223617 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 06:40:43.223632 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":90,"threads_started":1}
I20260810 06:40:43.224676 1695 tablet_service.cc:1467] Processing CreateTablet for tablet 7e0c7950fb24447282e9a09a06fa75f2 (DEFAULT_TABLE table=test-table [id=a163afb3ac3a48e0b85e8eb6c54fd6ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:43.224660 2054 tablet_service.cc:1467] Processing CreateTablet for tablet 7e0c7950fb24447282e9a09a06fa75f2 (DEFAULT_TABLE table=test-table [id=a163afb3ac3a48e0b85e8eb6c54fd6ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:43.224866 2165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.222283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:35733 (local address 127.0.0.1:51534)
0810 06:40:43.223075 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:43.223084 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:43.223129 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:43.224026 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:43.224027 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:43.224030 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:43.224456 (+ 426us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:40:43.224457 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:43.224463 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:40:43.224482 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:43.224721 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:43.224722 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:43.224722 (+ 0us) client_negotiation.cc:769] Sending connection context
0810 06:40:43.224782 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 06:40:43.224796 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":776,"thread_start_us":71,"threads_started":1}
I20260810 06:40:43.225030 2054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e0c7950fb24447282e9a09a06fa75f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:43.225044 1695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e0c7950fb24447282e9a09a06fa75f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:43.225174 2167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.222508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51534 (local address 127.27.41.130:35733)
0810 06:40:43.222731 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.222736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.223191 (+ 455us) server_negotiation.cc:407] Connection header received
0810 06:40:43.223415 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.223426 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.223455 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.223547 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:43.224578 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:43.224587 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:43.224587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:43.224592 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:43.224633 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:43.224654 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:43.224727 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:43.224791 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 06:40:43.225082 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":98,"threads_started":1}
I20260810 06:40:43.225787 1874 tablet_service.cc:1467] Processing CreateTablet for tablet 7e0c7950fb24447282e9a09a06fa75f2 (DEFAULT_TABLE table=test-table [id=a163afb3ac3a48e0b85e8eb6c54fd6ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:43.226055 1874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e0c7950fb24447282e9a09a06fa75f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:43.228399 2173 tablet_bootstrap.cc:492] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165: Bootstrap starting.
I20260810 06:40:43.229171 2173 tablet_bootstrap.cc:654] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:43.229156 2174 tablet_bootstrap.cc:492] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140: Bootstrap starting.
I20260810 06:40:43.229519 2171 tablet_bootstrap.cc:492] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58: Bootstrap starting.
I20260810 06:40:43.229568 2173 log.cc:824] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:43.229875 2174 tablet_bootstrap.cc:654] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:43.230206 2174 log.cc:824] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:43.230230 2171 tablet_bootstrap.cc:654] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:43.230391 2173 tablet_bootstrap.cc:492] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165: No bootstrap required, opened a new log
I20260810 06:40:43.230515 2173 ts_tablet_manager.cc:1397] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 06:40:43.230609 2171 log.cc:824] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:43.231334 2174 tablet_bootstrap.cc:492] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140: No bootstrap required, opened a new log
I20260810 06:40:43.231412 2174 ts_tablet_manager.cc:1397] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:40:43.233238 2173 raft_consensus.cc:348] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11153782f8f742e593da5eede5919165" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38199 } } peers { permanent_uuid: "365a7f03f45943728d70ddf50957e140" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35733 } } peers { permanent_uuid: "ef309bbb5ac147018c2437134e7a1d58" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 35215 } }
I20260810 06:40:43.233511 2173 raft_consensus.cc:374] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:43.233579 2173 raft_consensus.cc:729] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11153782f8f742e593da5eede5919165, State: Initialized, Role: FOLLOWER
I20260810 06:40:43.233770 2173 consensus_queue.cc:260] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11153782f8f742e593da5eede5919165" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38199 } } peers { permanent_uuid: "365a7f03f45943728d70ddf50957e140" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35733 } } peers { permanent_uuid: "ef309bbb5ac147018c2437134e7a1d58" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 35215 } }
I20260810 06:40:43.234067 2173 ts_tablet_manager.cc:1428] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260810 06:40:43.234102 1795 heartbeater.cc:503] Master 127.27.41.190:38017 was elected leader, sending a full tablet report...
I20260810 06:40:43.234062 2174 raft_consensus.cc:348] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11153782f8f742e593da5eede5919165" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38199 } } peers { permanent_uuid: "365a7f03f45943728d70ddf50957e140" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35733 } } peers { permanent_uuid: "ef309bbb5ac147018c2437134e7a1d58" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 35215 } }
I20260810 06:40:43.234203 2174 raft_consensus.cc:374] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:43.234239 2174 raft_consensus.cc:729] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 365a7f03f45943728d70ddf50957e140, State: Initialized, Role: FOLLOWER
I20260810 06:40:43.234360 2174 consensus_queue.cc:260] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11153782f8f742e593da5eede5919165" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38199 } } peers { permanent_uuid: "365a7f03f45943728d70ddf50957e140" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35733 } } peers { permanent_uuid: "ef309bbb5ac147018c2437134e7a1d58" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 35215 } }
I20260810 06:40:43.234676 2174 ts_tablet_manager.cc:1428] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260810 06:40:43.234687 1966 heartbeater.cc:503] Master 127.27.41.190:38017 was elected leader, sending a full tablet report...
I20260810 06:40:43.235275 2171 tablet_bootstrap.cc:492] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58: No bootstrap required, opened a new log
I20260810 06:40:43.235349 2171 ts_tablet_manager.cc:1397] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260810 06:40:43.237402 2171 raft_consensus.cc:348] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11153782f8f742e593da5eede5919165" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38199 } } peers { permanent_uuid: "365a7f03f45943728d70ddf50957e140" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35733 } } peers { permanent_uuid: "ef309bbb5ac147018c2437134e7a1d58" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 35215 } }
I20260810 06:40:43.237545 2171 raft_consensus.cc:374] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:43.237568 2171 raft_consensus.cc:729] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef309bbb5ac147018c2437134e7a1d58, State: Initialized, Role: FOLLOWER
I20260810 06:40:43.237682 2171 consensus_queue.cc:260] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11153782f8f742e593da5eede5919165" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38199 } } peers { permanent_uuid: "365a7f03f45943728d70ddf50957e140" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35733 } } peers { permanent_uuid: "ef309bbb5ac147018c2437134e7a1d58" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 35215 } }
I20260810 06:40:43.237993 2171 ts_tablet_manager.cc:1428] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:40:43.238008 2151 heartbeater.cc:503] Master 127.27.41.190:38017 was elected leader, sending a full tablet report...
I20260810 06:40:43.300346 2178 raft_consensus.cc:482] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:43.300551 2178 raft_consensus.cc:504] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11153782f8f742e593da5eede5919165" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38199 } } peers { permanent_uuid: "365a7f03f45943728d70ddf50957e140" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35733 } } peers { permanent_uuid: "ef309bbb5ac147018c2437134e7a1d58" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 35215 } }
I20260810 06:40:43.301044 2178 leader_election.cc:288] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 365a7f03f45943728d70ddf50957e140 (127.27.41.130:35733), ef309bbb5ac147018c2437134e7a1d58 (127.27.41.131:35215)
I20260810 06:40:43.302554 1798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.301241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:35733 (local address 127.27.41.129:53509)
0810 06:40:43.301316 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:43.301329 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:43.301390 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:43.301589 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:43.301590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:43.301593 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:43.302106 (+ 513us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:40:43.302107 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:43.302116 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:40:43.302132 (+ 16us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:43.302358 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:43.302359 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:43.302359 (+ 0us) client_negotiation.cc:769] Sending connection context
0810 06:40:43.302443 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 06:40:43.302475 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 06:40:43.302570 2167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.301383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:53509 (local address 127.27.41.130:35733)
0810 06:40:43.301438 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.301440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.301449 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:43.301479 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.301480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.301487 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.301578 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:43.302230 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:43.302231 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:43.302232 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:43.302248 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:43.302270 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:43.302276 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:43.302353 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:43.302448 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 06:40:43.302480 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 06:40:43.302699 2182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.301242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:35215 (local address 127.27.41.129:42159)
0810 06:40:43.301497 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:43.301508 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:43.301575 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:43.301724 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:43.301725 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:43.301727 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:43.302296 (+ 569us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:40:43.302297 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:43.302317 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:40:43.302329 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:43.302528 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:43.302528 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:43.302544 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 06:40:43.302598 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 06:40:43.302612 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":13,"thread_start_us":130,"threads_started":1}
I20260810 06:40:43.302697 2163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.301474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:42159 (local address 127.27.41.131:35215)
0810 06:40:43.301523 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.301525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.301568 (+ 43us) server_negotiation.cc:407] Connection header received
0810 06:40:43.301636 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.301637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.301642 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.301706 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:43.302414 (+ 708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:43.302415 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:43.302416 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:43.302421 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:43.302441 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:43.302446 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:43.302521 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:43.302598 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 06:40:43.302612 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 06:40:43.302919 1898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0c7950fb24447282e9a09a06fa75f2" candidate_uuid: "11153782f8f742e593da5eede5919165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365a7f03f45943728d70ddf50957e140" is_pre_election: true
I20260810 06:40:43.303061 2078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0c7950fb24447282e9a09a06fa75f2" candidate_uuid: "11153782f8f742e593da5eede5919165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef309bbb5ac147018c2437134e7a1d58" is_pre_election: true
I20260810 06:40:43.303103 1898 raft_consensus.cc:2454] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11153782f8f742e593da5eede5919165 in term 0.
I20260810 06:40:43.303229 2078 raft_consensus.cc:2454] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11153782f8f742e593da5eede5919165 in term 0.
I20260810 06:40:43.303370 1637 leader_election.cc:302] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11153782f8f742e593da5eede5919165, 365a7f03f45943728d70ddf50957e140; no voters:
I20260810 06:40:43.303498 2178 raft_consensus.cc:2781] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:43.303558 2178 raft_consensus.cc:482] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:43.303582 2178 raft_consensus.cc:3037] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:43.304312 2178 raft_consensus.cc:504] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11153782f8f742e593da5eede5919165" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38199 } } peers { permanent_uuid: "365a7f03f45943728d70ddf50957e140" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35733 } } peers { permanent_uuid: "ef309bbb5ac147018c2437134e7a1d58" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 35215 } }
I20260810 06:40:43.304447 2178 leader_election.cc:288] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [CANDIDATE]: Term 1 election: Requested vote from peers 365a7f03f45943728d70ddf50957e140 (127.27.41.130:35733), ef309bbb5ac147018c2437134e7a1d58 (127.27.41.131:35215)
I20260810 06:40:43.304620 2078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0c7950fb24447282e9a09a06fa75f2" candidate_uuid: "11153782f8f742e593da5eede5919165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef309bbb5ac147018c2437134e7a1d58"
I20260810 06:40:43.304687 2078 raft_consensus.cc:3037] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:43.305653 2078 raft_consensus.cc:2454] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11153782f8f742e593da5eede5919165 in term 1.
I20260810 06:40:43.305775 1898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e0c7950fb24447282e9a09a06fa75f2" candidate_uuid: "11153782f8f742e593da5eede5919165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365a7f03f45943728d70ddf50957e140"
I20260810 06:40:43.305840 1636 leader_election.cc:302] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11153782f8f742e593da5eede5919165, ef309bbb5ac147018c2437134e7a1d58; no voters:
I20260810 06:40:43.305857 1898 raft_consensus.cc:3037] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:43.305953 2178 raft_consensus.cc:2781] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:43.306121 2178 raft_consensus.cc:686] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [term 1 LEADER]: Becoming Leader. State: Replica: 11153782f8f742e593da5eede5919165, State: Running, Role: LEADER
I20260810 06:40:43.306224 2178 consensus_queue.cc:237] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11153782f8f742e593da5eede5919165" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38199 } } peers { permanent_uuid: "365a7f03f45943728d70ddf50957e140" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35733 } } peers { permanent_uuid: "ef309bbb5ac147018c2437134e7a1d58" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 35215 } }
I20260810 06:40:43.306777 1898 raft_consensus.cc:2454] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11153782f8f742e593da5eede5919165 in term 1.
I20260810 06:40:43.307255 1529 catalog_manager.cc:5495] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11153782f8f742e593da5eede5919165 (127.27.41.129). New cstate: current_term: 1 leader_uuid: "11153782f8f742e593da5eede5919165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11153782f8f742e593da5eede5919165" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "365a7f03f45943728d70ddf50957e140" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef309bbb5ac147018c2437134e7a1d58" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 35215 } health_report { overall_health: UNKNOWN } } }
I20260810 06:40:43.316583 2164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.315590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58232 (local address 127.27.41.129:38199)
0810 06:40:43.315642 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.315644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.315705 (+ 61us) server_negotiation.cc:407] Connection header received
0810 06:40:43.315759 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.315760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.315769 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.315807 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:43.316376 (+ 569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:43.316377 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:43.316378 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:43.316382 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:43.316397 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:43.316402 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:43.316474 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:43.316522 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 06:40:43.316542 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:40:43.318387 1898 raft_consensus.cc:1261] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140 [term 1 FOLLOWER]: Refusing update from remote peer 11153782f8f742e593da5eede5919165: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:43.318406 2078 raft_consensus.cc:1261] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58 [term 1 FOLLOWER]: Refusing update from remote peer 11153782f8f742e593da5eede5919165: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:43.318732 2186 consensus_queue.cc:1035] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef309bbb5ac147018c2437134e7a1d58" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 35215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:43.318861 2178 consensus_queue.cc:1035] T 7e0c7950fb24447282e9a09a06fa75f2 P 11153782f8f742e593da5eede5919165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "365a7f03f45943728d70ddf50957e140" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:43.321655 2189 mvcc.cc:205] Tried to move back new op lower bound from 7316865201429270528 to 7316865201383038976. Current Snapshot: MvccSnapshot[applied={T|T < 7316865201429270528}]
I20260810 06:40:43.321792 2192 mvcc.cc:205] Tried to move back new op lower bound from 7316865201429270528 to 7316865201383038976. Current Snapshot: MvccSnapshot[applied={T|T < 7316865201429270528}]
I20260810 06:40:43.322422 2191 mvcc.cc:205] Tried to move back new op lower bound from 7316865201429270528 to 7316865201383038976. Current Snapshot: MvccSnapshot[applied={T|T < 7316865201429270528 or (T in {7316865201429270528})}]
I20260810 06:40:43.324209 1529 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:43.324326 1529 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:43.325117 1529 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ccd33840b13f432fbef115c76253248a: Sending DeleteTablet for 3 replicas of tablet 7e0c7950fb24447282e9a09a06fa75f2
I20260810 06:40:43.325531 2054 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e0c7950fb24447282e9a09a06fa75f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:43 UTC) from {username='slave'} at 127.0.0.1:36180
I20260810 06:40:43.325564 1695 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e0c7950fb24447282e9a09a06fa75f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:43 UTC) from {username='slave'} at 127.0.0.1:58226
I20260810 06:40:43.325731 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 1613
I20260810 06:40:43.327888 1874 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e0c7950fb24447282e9a09a06fa75f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:43 UTC) from {username='slave'} at 127.0.0.1:51534
I20260810 06:40:43.331738 2202 tablet_replica.cc:330] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58: stopping tablet replica
I20260810 06:40:43.331837 2202 raft_consensus.cc:2229] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:43.331930 2202 raft_consensus.cc:2258] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:43.332737 2202 ts_tablet_manager.cc:1905] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:43.332836 2204 tablet_replica.cc:330] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140: stopping tablet replica
I20260810 06:40:43.332939 2204 raft_consensus.cc:2229] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:43.333042 2204 raft_consensus.cc:2258] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:43.333506 2204 ts_tablet_manager.cc:1905] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:43.334637 2202 ts_tablet_manager.cc:1918] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:43.334712 2202 log.cc:1196] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/7e0c7950fb24447282e9a09a06fa75f2
I20260810 06:40:43.334981 2202 ts_tablet_manager.cc:1939] T 7e0c7950fb24447282e9a09a06fa75f2 P ef309bbb5ac147018c2437134e7a1d58: Deleting consensus metadata
I20260810 06:40:43.335235 2204 ts_tablet_manager.cc:1918] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:43.335311 2204 log.cc:1196] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/7e0c7950fb24447282e9a09a06fa75f2
I20260810 06:40:43.335614 2204 ts_tablet_manager.cc:1939] T 7e0c7950fb24447282e9a09a06fa75f2 P 365a7f03f45943728d70ddf50957e140: Deleting consensus metadata
I20260810 06:40:43.335901 1508 catalog_manager.cc:4841] TS ef309bbb5ac147018c2437134e7a1d58 (127.27.41.131:35215): tablet 7e0c7950fb24447282e9a09a06fa75f2 (table test-table [id=a163afb3ac3a48e0b85e8eb6c54fd6ca]) successfully deleted
I20260810 06:40:43.336062 1510 catalog_manager.cc:4841] TS 365a7f03f45943728d70ddf50957e140 (127.27.41.130:35733): tablet 7e0c7950fb24447282e9a09a06fa75f2 (table test-table [id=a163afb3ac3a48e0b85e8eb6c54fd6ca]) successfully deleted
W20260810 06:40:43.340648 1510 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:38199 (error 108)
I20260810 06:40:43.340822 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 1799
I20260810 06:40:43.341179 2165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.341024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:38199 (local address 127.0.0.1:58248)
0810 06:40:43.341071 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:43.341109 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:38199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 06:40:43.346338 1510 catalog_manager.cc:4584] TS 11153782f8f742e593da5eede5919165 (127.27.41.129:38199): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7e0c7950fb24447282e9a09a06fa75f2: Network error: Client connection negotiation failed: client connection to 127.27.41.129:38199: connect: Connection refused (error 111)
I20260810 06:40:43.353163 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 1970
I20260810 06:40:43.361372 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 1490
2026-08-10T06:40:43Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (668 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260810 06:40:43.387377 27814 mini_oidc.cc:152] Starting JWKS server
I20260810 06:40:43.388514 27814 webserver.cc:460] Webserver started at https://127.0.0.1:37033/ using document root <none> and password file <none>
I20260810 06:40:43.388592 27814 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 06:40:43.388718 27814 webserver.cc:460] Webserver started at http://127.0.0.1:44667/ using document root <none> and password file <none>
2026-08-10T06:40:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:43Z Disabled control of system clock
I20260810 06:40:43.397609 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:41711
--webserver_interface=127.27.41.190
--webserver_port=0
--builtin_ntp_servers=127.27.41.148:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:41711
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37033/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/testchainca.cert with env {}
W20260810 06:40:43.480772 2214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:43.480964 2214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:43.480986 2214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:43.482182 2214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:43.482225 2214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:43.482239 2214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:43.482251 2214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:43.482263 2214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 06:40:43.482275 2214 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 06:40:43.482316 2214 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37033/jwks.json
I20260810 06:40:43.483884 2214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:41711
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:41711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37033/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:43.484125 2214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:43.484356 2214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:43.489274 2224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:43.489392 2222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:43.489274 2221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:43.489565 2214 server_base.cc:1034] running on GCE node
I20260810 06:40:43.489902 2214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:43.490201 2214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:43.491392 2214 hybrid_clock.cc:648] HybridClock initialized: now 1786344043491355 us; error 61 us; skew 500 ppm
I20260810 06:40:43.492740 2214 webserver.cc:460] Webserver started at http://127.27.41.190:38833/ using document root <none> and password file <none>
I20260810 06:40:43.492997 2214 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:43.493075 2214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:43.493232 2214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:43.494284 2214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "d6508b7e967240fface6055081366b06"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "dfc305e770a31a96f01785daa3d5f44b"
server_key_iv: "03ed3ce9fe8c9ed473a308344a73247a"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.494683 2214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "d6508b7e967240fface6055081366b06"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "dfc305e770a31a96f01785daa3d5f44b"
server_key_iv: "03ed3ce9fe8c9ed473a308344a73247a"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.496021 2214 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 06:40:43.496785 2234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:43.496973 2214 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:43.497082 2214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "d6508b7e967240fface6055081366b06"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "dfc305e770a31a96f01785daa3d5f44b"
server_key_iv: "03ed3ce9fe8c9ed473a308344a73247a"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.497191 2214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:43.512300 2214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:43.512571 2214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:43.512715 2214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:43.516633 2214 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:41711
I20260810 06:40:43.516669 2310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:41711 every 8 connection(s)
I20260810 06:40:43.516986 2214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:43.517971 2311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:43.520118 2311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06: Bootstrap starting.
I20260810 06:40:43.520740 2311 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:43.521057 2311 log.cc:824] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:43.521751 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 2214
I20260810 06:40:43.521863 2311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06: No bootstrap required, opened a new log
I20260810 06:40:43.521876 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:43.522074 27814 external_mini_cluster.cc:1428] Setting key f5e92fcd5a8930bcda3daff089ffde61
I20260810 06:40:43.523917 2311 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6508b7e967240fface6055081366b06" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41711 } }
I20260810 06:40:43.524093 2311 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:43.524132 2311 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6508b7e967240fface6055081366b06, State: Initialized, Role: FOLLOWER
I20260810 06:40:43.524250 2311 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6508b7e967240fface6055081366b06" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41711 } }
I20260810 06:40:43.524355 2311 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:43.524389 2311 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:43.524436 2311 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:43.525147 2311 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6508b7e967240fface6055081366b06" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41711 } }
I20260810 06:40:43.525256 2311 leader_election.cc:302] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6508b7e967240fface6055081366b06; no voters:
I20260810 06:40:43.525431 2311 leader_election.cc:288] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:43.525501 2318 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:43.525661 2311 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:43.525650 2318 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [term 1 LEADER]: Becoming Leader. State: Replica: d6508b7e967240fface6055081366b06, State: Running, Role: LEADER
I20260810 06:40:43.525810 2318 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6508b7e967240fface6055081366b06" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41711 } }
I20260810 06:40:43.526888 2321 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6508b7e967240fface6055081366b06. Latest consensus state: current_term: 1 leader_uuid: "d6508b7e967240fface6055081366b06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6508b7e967240fface6055081366b06" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41711 } } }
I20260810 06:40:43.526994 2321 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:43.527153 2319 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6508b7e967240fface6055081366b06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6508b7e967240fface6055081366b06" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41711 } } }
I20260810 06:40:43.527468 2319 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:43.527271 2338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:43.528110 2338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:43.529743 2317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.522607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41884 (local address 127.27.41.190:41711)
0810 06:40:43.522821 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.522829 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.522860 (+ 31us) server_negotiation.cc:407] Connection header received
0810 06:40:43.523885 (+ 1025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.523894 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.523970 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.524121 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:43.524378 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.526073 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.527335 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.527893 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.528037 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:43.528789 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:43.528794 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:43.528794 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:43.529046 (+ 252us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:43.529087 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:43.529102 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:43.529168 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:43.529430 (+ 262us) server_negotiation.cc:299] Negotiation successful
0810 06:40:43.529515 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":76,"threads_started":1}
I20260810 06:40:43.530164 2338 catalog_manager.cc:1347] Generated new cluster ID: 520d33e8d0e64233a885ddb3d3ff02ef
I20260810 06:40:43.530218 2338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:43.530584 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:40:43.548497 2338 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:43.549209 2338 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:43.552161 2338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6508b7e967240fface6055081366b06: Generated new TSK 0
I20260810 06:40:43.552326 2338 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 06:40:43.579736 2351 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260810 06:40:43.579887 2351 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 06:40:43.580034 2317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.564717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41898 (local address 127.27.41.190:41711)
0810 06:40:43.564778 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.564782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.564908 (+ 126us) server_negotiation.cc:407] Connection header received
0810 06:40:43.565006 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.565007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.565018 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.565080 (+ 62us) server_negotiation.cc:226] Negotiated authn=JWT
0810 06:40:43.565270 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.565809 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.567020 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.567208 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.567269 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:43.567510 (+ 241us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 06:40:43.579794 (+ 12284us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37033/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 06:40:43.579963 (+ 169us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41898: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37033/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":38}
W20260810 06:40:43.580114 2317 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41898: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37033/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260810 06:40:43.580613 2349 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:43.564595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:41711 (local address 127.0.0.1:41898)
0810 06:40:43.564825 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:43.564837 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:43.564913 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:43.565112 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:43.565113 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:43.565120 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0810 06:40:43.565199 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:43.565201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.565929 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.565930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:43.566919 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:43.566923 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.567308 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.567309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:43.567381 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:43.567403 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 06:40:43.580056 (+ 12653us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37033/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 06:40:43.580185 (+ 129us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.41.190:41711: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37033/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":106,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.27.41.190:41711: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37033/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260810 06:40:43.581245 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 2214
2026-08-10T06:40:43Z chronyd exiting
I20260810 06:40:43.629540 27814 test_util.cc:175] -----------------------------------------------
I20260810 06:40:43.629612 27814 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786344020082892-27814-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (243 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260810 06:40:43.630309 27814 mini_oidc.cc:152] Starting JWKS server
I20260810 06:40:43.630975 27814 webserver.cc:460] Webserver started at https://127.0.0.1:41425/ using document root <none> and password file <none>
I20260810 06:40:43.631047 27814 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 06:40:43.631196 27814 webserver.cc:460] Webserver started at http://127.0.0.1:41449/ using document root <none> and password file <none>
2026-08-10T06:40:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:43Z Disabled control of system clock
I20260810 06:40:43.640141 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:39977
--webserver_interface=127.27.41.190
--webserver_port=0
--builtin_ntp_servers=127.27.41.148:40709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:39977
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41425/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/testchainca.cert with env {}
W20260810 06:40:43.720141 2359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:43.720325 2359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:43.720347 2359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:43.721515 2359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:43.721557 2359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:43.721570 2359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:43.721583 2359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:43.721596 2359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 06:40:43.721607 2359 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 06:40:43.721619 2359 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41425/jwks.json
I20260810 06:40:43.723047 2359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:40709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:39977
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:39977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41425/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:43.723238 2359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:43.723417 2359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:43.728137 2368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:43.728147 2365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:43.728197 2364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:43.728551 2359 server_base.cc:1034] running on GCE node
I20260810 06:40:43.728798 2359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:43.729111 2359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:43.730261 2359 hybrid_clock.cc:648] HybridClock initialized: now 1786344043730234 us; error 52 us; skew 500 ppm
I20260810 06:40:43.731474 2359 webserver.cc:460] Webserver started at http://127.27.41.190:36825/ using document root <none> and password file <none>
I20260810 06:40:43.731734 2359 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:43.731810 2359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:43.731952 2359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:43.733021 2359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "56982d23780743b29bfee44e272d7e55"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "4f65178211389f02a873c563c737671e"
server_key_iv: "de659e1338493355827678acf5e0477f"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.733438 2359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "56982d23780743b29bfee44e272d7e55"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "4f65178211389f02a873c563c737671e"
server_key_iv: "de659e1338493355827678acf5e0477f"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.734699 2359 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:43.735505 2377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:43.735685 2359 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:43.735787 2359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "56982d23780743b29bfee44e272d7e55"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "4f65178211389f02a873c563c737671e"
server_key_iv: "de659e1338493355827678acf5e0477f"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.735872 2359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:43.747618 2359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:43.747936 2359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:43.748093 2359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:43.752230 2359 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:39977
I20260810 06:40:43.752264 2446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:39977 every 8 connection(s)
I20260810 06:40:43.752624 2359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:43.753309 2447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:43.754420 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 2359
I20260810 06:40:43.754544 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:43.754739 27814 external_mini_cluster.cc:1428] Setting key 654f3da83b12b5288259ef49ed1d4d34
I20260810 06:40:43.756784 2447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55: Bootstrap starting.
I20260810 06:40:43.757494 2447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:43.757823 2447 log.cc:824] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:43.758586 2447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55: No bootstrap required, opened a new log
I20260810 06:40:43.760324 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.755275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42954 (local address 127.27.41.190:39977)
0810 06:40:43.755471 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.755479 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.755508 (+ 29us) server_negotiation.cc:407] Connection header received
0810 06:40:43.755898 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.755904 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.755961 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.756086 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:43.756333 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.757276 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.758376 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.758816 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.758903 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:43.759629 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:43.759633 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:43.759633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:43.759805 (+ 172us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:43.759837 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:43.759846 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:43.759897 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:43.760015 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 06:40:43.760125 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
I20260810 06:40:43.760922 2447 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56982d23780743b29bfee44e272d7e55" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39977 } }
I20260810 06:40:43.761135 2447 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:43.761224 2447 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56982d23780743b29bfee44e272d7e55, State: Initialized, Role: FOLLOWER
I20260810 06:40:43.761389 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:40:43.761405 2447 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56982d23780743b29bfee44e272d7e55" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39977 } }
I20260810 06:40:43.761524 2447 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:43.761576 2447 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:43.761627 2447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:43.762240 2447 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56982d23780743b29bfee44e272d7e55" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39977 } }
I20260810 06:40:43.762370 2447 leader_election.cc:302] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56982d23780743b29bfee44e272d7e55; no voters:
I20260810 06:40:43.762548 2447 leader_election.cc:288] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:43.762570 2456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:43.762703 2456 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [term 1 LEADER]: Becoming Leader. State: Replica: 56982d23780743b29bfee44e272d7e55, State: Running, Role: LEADER
I20260810 06:40:43.762807 2447 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:43.762835 2456 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56982d23780743b29bfee44e272d7e55" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39977 } }
I20260810 06:40:43.763226 2459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56982d23780743b29bfee44e272d7e55. Latest consensus state: current_term: 1 leader_uuid: "56982d23780743b29bfee44e272d7e55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56982d23780743b29bfee44e272d7e55" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39977 } } }
I20260810 06:40:43.763226 2457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56982d23780743b29bfee44e272d7e55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56982d23780743b29bfee44e272d7e55" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39977 } } }
I20260810 06:40:43.763387 2459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:43.763397 2457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:43.763728 2470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:43.764366 2470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:43.766139 2470 catalog_manager.cc:1347] Generated new cluster ID: 698675d033c94ada8aad0756974ea6ed
I20260810 06:40:43.766197 2470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:43.773689 2470 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:43.774372 2470 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:43.782196 2470 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56982d23780743b29bfee44e272d7e55: Generated new TSK 0
I20260810 06:40:43.782382 2470 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 06:40:43.805290 2495 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260810 06:40:43.805402 2495 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 06:40:43.805776 2453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.791704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42966 (local address 127.27.41.190:39977)
0810 06:40:43.791775 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.791777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.791889 (+ 112us) server_negotiation.cc:407] Connection header received
0810 06:40:43.791991 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.791991 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.792004 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.792089 (+ 85us) server_negotiation.cc:226] Negotiated authn=JWT
0810 06:40:43.792245 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.792748 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.793628 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.793840 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.793914 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:43.794109 (+ 195us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 06:40:43.805536 (+ 11427us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41425/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 06:40:43.805704 (+ 168us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42966: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41425/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":45}
W20260810 06:40:43.805840 2453 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42966: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41425/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260810 06:40:43.805843 2492 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:43.791635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:39977 (local address 127.0.0.1:42966)
0810 06:40:43.791813 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:43.791829 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:43.791897 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:43.792088 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:43.792089 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:43.792091 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0810 06:40:43.792172 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:43.792174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.792850 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.792852 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:43.793542 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:43.793545 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.793915 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.793916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:43.793990 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:43.794000 (+ 10us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 06:40:43.805649 (+ 11649us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41425/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 06:40:43.805747 (+ 98us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.41.190:39977: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41425/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":105,"threads_started":1}
I20260810 06:40:43.806195 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 2359
2026-08-10T06:40:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (220 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260810 06:40:43.851138 27814 mini_oidc.cc:152] Starting JWKS server
I20260810 06:40:43.851788 27814 webserver.cc:460] Webserver started at https://127.0.0.1:42683/ using document root <none> and password file <none>
I20260810 06:40:43.851830 27814 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 06:40:43.851979 27814 webserver.cc:460] Webserver started at http://127.0.0.1:42095/ using document root <none> and password file <none>
2026-08-10T06:40:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:43Z Disabled control of system clock
I20260810 06:40:43.860836 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:42493
--webserver_interface=127.27.41.190
--webserver_port=0
--builtin_ntp_servers=127.27.41.148:45579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:42493
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42683/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 06:40:43.940908 2503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:43.941161 2503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:43.941201 2503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:43.942404 2503 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:43.942476 2503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:43.942497 2503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:43.942516 2503 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:43.942546 2503 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 06:40:43.942569 2503 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 06:40:43.942606 2503 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42683/jwks.json
I20260810 06:40:43.943974 2503 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:45579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:42493
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:42493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42683/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:43.944244 2503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:43.944540 2503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:43.949498 2511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:43.949512 2517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:43.949542 2503 server_base.cc:1034] running on GCE node
W20260810 06:40:43.949532 2514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:43.949903 2503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:43.950199 2503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:43.951368 2503 hybrid_clock.cc:648] HybridClock initialized: now 1786344043951353 us; error 44 us; skew 500 ppm
I20260810 06:40:43.952708 2503 webserver.cc:460] Webserver started at http://127.27.41.190:36841/ using document root <none> and password file <none>
I20260810 06:40:43.952988 2503 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:43.953063 2503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:43.953218 2503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:43.954352 2503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "cb0fd2aa84e248709f201ee4a0d0ba4f"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "3ba56e9d8fd4c42e3c0db5bf85dedac2"
server_key_iv: "fee4c11aa0a4c4232f460572c9175b14"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.954732 2503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "cb0fd2aa84e248709f201ee4a0d0ba4f"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "3ba56e9d8fd4c42e3c0db5bf85dedac2"
server_key_iv: "fee4c11aa0a4c4232f460572c9175b14"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.956055 2503 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:40:43.956749 2527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:43.956900 2503 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:43.957017 2503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "cb0fd2aa84e248709f201ee4a0d0ba4f"
format_stamp: "Formatted at 2026-08-10 06:40:43 on dist-test-slave-bw88"
server_key: "3ba56e9d8fd4c42e3c0db5bf85dedac2"
server_key_iv: "fee4c11aa0a4c4232f460572c9175b14"
server_key_version: "encryptionkey@0"
I20260810 06:40:43.957103 2503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:43.977188 2503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:43.977550 2503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:43.977702 2503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:43.981840 2503 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:42493
I20260810 06:40:43.981873 2598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:42493 every 8 connection(s)
I20260810 06:40:43.982223 2503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:43.982883 2599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:43.985288 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 2503
I20260810 06:40:43.985423 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:43.985634 27814 external_mini_cluster.cc:1428] Setting key 118f44b7a5feee0416279f95aff4f0e8
I20260810 06:40:43.985677 2599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f: Bootstrap starting.
I20260810 06:40:43.986382 2599 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:43.986685 2599 log.cc:824] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:43.987509 2599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f: No bootstrap required, opened a new log
I20260810 06:40:43.989675 2599 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb0fd2aa84e248709f201ee4a0d0ba4f" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 42493 } }
I20260810 06:40:43.989818 2599 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:43.989840 2599 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0fd2aa84e248709f201ee4a0d0ba4f, State: Initialized, Role: FOLLOWER
I20260810 06:40:43.990006 2599 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb0fd2aa84e248709f201ee4a0d0ba4f" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 42493 } }
I20260810 06:40:43.990101 2599 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:43.990140 2599 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:43.990190 2599 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:43.990856 2599 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb0fd2aa84e248709f201ee4a0d0ba4f" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 42493 } }
I20260810 06:40:43.990988 2599 leader_election.cc:302] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb0fd2aa84e248709f201ee4a0d0ba4f; no voters:
I20260810 06:40:43.991170 2599 leader_election.cc:288] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:43.991197 2611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:43.991357 2611 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [term 1 LEADER]: Becoming Leader. State: Replica: cb0fd2aa84e248709f201ee4a0d0ba4f, State: Running, Role: LEADER
I20260810 06:40:43.991431 2599 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:43.991467 2611 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb0fd2aa84e248709f201ee4a0d0ba4f" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 42493 } }
I20260810 06:40:43.991787 2604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:43.986110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50452 (local address 127.27.41.190:42493)
0810 06:40:43.986298 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:43.986305 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:43.986328 (+ 23us) server_negotiation.cc:407] Connection header received
0810 06:40:43.986855 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:43.986862 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:43.986956 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:43.987111 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:43.987321 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.988232 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.989454 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:43.989907 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:43.990043 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:43.990726 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:43.990730 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:43.990730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:43.990897 (+ 167us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:43.990941 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:43.990951 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:43.991041 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:43.991263 (+ 222us) server_negotiation.cc:299] Negotiation successful
0810 06:40:43.991344 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":90,"threads_started":1}
I20260810 06:40:43.991787 2613 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb0fd2aa84e248709f201ee4a0d0ba4f. Latest consensus state: current_term: 1 leader_uuid: "cb0fd2aa84e248709f201ee4a0d0ba4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb0fd2aa84e248709f201ee4a0d0ba4f" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 42493 } } }
I20260810 06:40:43.991879 2612 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb0fd2aa84e248709f201ee4a0d0ba4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb0fd2aa84e248709f201ee4a0d0ba4f" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 42493 } } }
I20260810 06:40:43.992226 2612 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:43.992223 2613 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:43.992484 2623 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:43.993073 2623 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:43.993090 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:40:43.994678 2623 catalog_manager.cc:1347] Generated new cluster ID: 60a9a618253342179fdf70b7695e4597
I20260810 06:40:43.994729 2623 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:43.999533 2623 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:44.000159 2623 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:44.006160 2623 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb0fd2aa84e248709f201ee4a0d0ba4f: Generated new TSK 0
I20260810 06:40:44.006323 2623 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:40:44.019318 2604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:44.015352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50466 (local address 127.27.41.190:42493)
0810 06:40:44.015408 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:44.015410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:44.015536 (+ 126us) server_negotiation.cc:407] Connection header received
0810 06:40:44.015574 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:44.015575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:44.015587 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:44.015661 (+ 74us) server_negotiation.cc:226] Negotiated authn=JWT
0810 06:40:44.015779 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:44.016789 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:44.017677 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:44.017983 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:44.018049 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:44.018207 (+ 158us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 06:40:44.019128 (+ 921us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42683/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 06:40:44.019255 (+ 127us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50466: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42683/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":34}
W20260810 06:40:44.019367 2604 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50466: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42683/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260810 06:40:44.019413 2644 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:44.015263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:42493 (local address 127.0.0.1:50466)
0810 06:40:44.015461 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:44.015475 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:44.015528 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:44.015669 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:44.015670 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:44.015671 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0810 06:40:44.015719 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:44.015721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:44.016934 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:44.016935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:44.017575 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:44.017577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:44.018073 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:44.018074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:44.018115 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:44.018120 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 06:40:44.019226 (+ 1106us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42683/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 06:40:44.019319 (+ 93us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.41.190:42493: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42683/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":108,"threads_started":1}
I20260810 06:40:44.019814 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 2503
E20260810 06:40:44.032286 2645 webserver.cc:533] Webserver: sslize failed:
E20260810 06:40:44.032344 2645 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-10T06:40:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (210 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-10T06:40:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:44Z Disabled control of system clock
I20260810 06:40:44.071136 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:39721
--webserver_interface=127.27.41.190
--webserver_port=0
--builtin_ntp_servers=127.27.41.148:35563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:39721
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/testchainca.cert with env {}
W20260810 06:40:44.152388 2650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:44.152576 2650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:44.152597 2650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:44.153666 2650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:44.153699 2650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:44.153712 2650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:44.153723 2650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:44.153734 2650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 06:40:44.153746 2650 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 06:40:44.153757 2650 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260810 06:40:44.155242 2650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:39721
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:39721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:44.155457 2650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:44.155613 2650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:44.160380 2657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:44.160386 2658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:44.160398 2660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:44.160663 2650 server_base.cc:1034] running on GCE node
I20260810 06:40:44.160969 2650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:44.161276 2650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:44.162451 2650 hybrid_clock.cc:648] HybridClock initialized: now 1786344044162431 us; error 35 us; skew 500 ppm
I20260810 06:40:44.163605 2650 webserver.cc:460] Webserver started at http://127.27.41.190:41797/ using document root <none> and password file <none>
I20260810 06:40:44.163870 2650 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:44.163951 2650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:44.164112 2650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:44.165262 2650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "5a0bb88a4bab4f80b8b1250eac907a28"
format_stamp: "Formatted at 2026-08-10 06:40:44 on dist-test-slave-bw88"
server_key: "bd62ceef03a316bde92de0a256db5572"
server_key_iv: "ef23f29f0c9480c766a112ac43fd43f0"
server_key_version: "encryptionkey@0"
I20260810 06:40:44.165676 2650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "5a0bb88a4bab4f80b8b1250eac907a28"
format_stamp: "Formatted at 2026-08-10 06:40:44 on dist-test-slave-bw88"
server_key: "bd62ceef03a316bde92de0a256db5572"
server_key_iv: "ef23f29f0c9480c766a112ac43fd43f0"
server_key_version: "encryptionkey@0"
I20260810 06:40:44.166934 2650 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:44.167610 2667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:44.167780 2650 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:44.167891 2650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "5a0bb88a4bab4f80b8b1250eac907a28"
format_stamp: "Formatted at 2026-08-10 06:40:44 on dist-test-slave-bw88"
server_key: "bd62ceef03a316bde92de0a256db5572"
server_key_iv: "ef23f29f0c9480c766a112ac43fd43f0"
server_key_version: "encryptionkey@0"
I20260810 06:40:44.167974 2650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:44.180999 2650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:44.181296 2650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:44.181468 2650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:44.185313 2650 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:39721
I20260810 06:40:44.185325 2741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:39721 every 8 connection(s)
I20260810 06:40:44.185717 2650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:44.186748 2742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:44.188822 2742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28: Bootstrap starting.
I20260810 06:40:44.189450 2742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:44.189720 2742 log.cc:824] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:44.190407 2742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28: No bootstrap required, opened a new log
I20260810 06:40:44.191996 2742 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a0bb88a4bab4f80b8b1250eac907a28" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39721 } }
I20260810 06:40:44.192127 2742 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:44.192173 2742 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a0bb88a4bab4f80b8b1250eac907a28, State: Initialized, Role: FOLLOWER
I20260810 06:40:44.192312 2742 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a0bb88a4bab4f80b8b1250eac907a28" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39721 } }
I20260810 06:40:44.192389 2742 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:44.192437 2742 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:44.192487 2742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:44.193008 2742 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a0bb88a4bab4f80b8b1250eac907a28" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39721 } }
I20260810 06:40:44.193122 2742 leader_election.cc:302] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a0bb88a4bab4f80b8b1250eac907a28; no voters:
I20260810 06:40:44.193277 2742 leader_election.cc:288] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:44.193318 2745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:44.193529 2745 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [term 1 LEADER]: Becoming Leader. State: Replica: 5a0bb88a4bab4f80b8b1250eac907a28, State: Running, Role: LEADER
I20260810 06:40:44.193593 2742 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:44.193656 2745 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a0bb88a4bab4f80b8b1250eac907a28" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39721 } }
I20260810 06:40:44.194061 2747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a0bb88a4bab4f80b8b1250eac907a28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a0bb88a4bab4f80b8b1250eac907a28" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39721 } } }
I20260810 06:40:44.194164 2747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:44.194339 2750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a0bb88a4bab4f80b8b1250eac907a28. Latest consensus state: current_term: 1 leader_uuid: "5a0bb88a4bab4f80b8b1250eac907a28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a0bb88a4bab4f80b8b1250eac907a28" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39721 } } }
I20260810 06:40:44.194420 2750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:44.194723 2757 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:44.195137 2757 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:44.195616 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 2650
I20260810 06:40:44.195713 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:44.195887 27814 external_mini_cluster.cc:1428] Setting key 9748e4c529893c97c307ca887cf17f58
I20260810 06:40:44.197132 2757 catalog_manager.cc:1347] Generated new cluster ID: 06723e009a8543be85d1a2b384c27cf8
I20260810 06:40:44.197192 2757 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:44.202212 2772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:44.196437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47314 (local address 127.27.41.190:39721)
0810 06:40:44.196670 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:44.196679 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:44.196716 (+ 37us) server_negotiation.cc:407] Connection header received
0810 06:40:44.196875 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:44.196882 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:44.196946 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:44.197092 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:44.197434 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:44.198732 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:44.199831 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:44.200429 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:44.200562 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:44.201296 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:44.201300 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:44.201300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:40:44.201530 (+ 230us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:44.201572 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:40:44.201587 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:44.201663 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:44.201759 (+ 96us) server_negotiation.cc:299] Negotiation successful
0810 06:40:44.201833 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":103,"threads_started":1}
I20260810 06:40:44.203219 2757 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:44.203405 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:40:44.203859 2757 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:44.208196 2757 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a0bb88a4bab4f80b8b1250eac907a28: Generated new TSK 0
I20260810 06:40:44.208371 2757 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:40:44.284298 2772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:44.220039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47320 (local address 127.27.41.190:39721)
0810 06:40:44.220099 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:44.220101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:44.220204 (+ 103us) server_negotiation.cc:407] Connection header received
0810 06:40:44.220259 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:44.220260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:44.220272 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:44.220348 (+ 76us) server_negotiation.cc:226] Negotiated authn=JWT
0810 06:40:44.220523 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:44.221324 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:44.222133 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:44.222474 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:44.222544 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:44.222703 (+ 159us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 06:40:44.283978 (+ 61275us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 06:40:44.284214 (+ 236us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47320: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 06:40:44.284395 2772 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47320: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260810 06:40:44.284453 2782 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:44.219945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:39721 (local address 127.0.0.1:47320)
0810 06:40:44.220103 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:44.220114 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:44.220200 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:44.220356 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:44.220357 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:44.220358 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0810 06:40:44.220445 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:44.220447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:44.221451 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:44.221452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:44.222044 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:44.222045 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:44.222554 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:44.222555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:44.222598 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:44.222603 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 06:40:44.284172 (+ 61569us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 06:40:44.284305 (+ 133us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.41.190:39721: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":107,"threads_started":1}
I20260810 06:40:44.284806 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 2650
2026-08-10T06:40:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (248 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (92 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (93 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:44 dist-test-slave-bw88 krb5kdc[2800](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:44 dist-test-slave-bw88 krb5kdc[2800](info): set up 2 sockets
Aug 10 06:40:44 dist-test-slave-bw88 krb5kdc[2800](info): commencing operation
krb5kdc: starting...
W20260810 06:40:45.657809 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:45 dist-test-slave-bw88 krb5kdc[2800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:40:45.776522 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:44059
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:36117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:44059
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:45.857872 2814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:45.858068 2814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:45.858090 2814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:45.859251 2814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:45.859293 2814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:45.859308 2814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:45.859352 2814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:45.859385 2814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:45.860873 2814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:44059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:44059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:45.861121 2814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:45.861387 2814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:45.866274 2825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:45.866292 2821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:45.866560 2814 server_base.cc:1034] running on GCE node
W20260810 06:40:45.866322 2823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:45.866886 2814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:45.867201 2814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:45.868362 2814 hybrid_clock.cc:648] HybridClock initialized: now 1786344045868330 us; error 53 us; skew 500 ppm
Aug 10 06:40:45 dist-test-slave-bw88 krb5kdc[2800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344045, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:45.875167 2814 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:40:45.875658 2814 webserver.cc:460] Webserver started at http://127.27.41.190:39295/ using document root <none> and password file <none>
I20260810 06:40:45.875907 2814 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:45.875977 2814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:45.876132 2814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:45.877195 2814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "fa9c31c8738345f8a2dfc2e67d7ae792"
format_stamp: "Formatted at 2026-08-10 06:40:45 on dist-test-slave-bw88"
server_key: "b380602a994a4802490b158ba8ddbc08"
server_key_iv: "5e06ff3c01e068fefc9219ebe90f85bf"
server_key_version: "encryptionkey@0"
I20260810 06:40:45.877616 2814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "fa9c31c8738345f8a2dfc2e67d7ae792"
format_stamp: "Formatted at 2026-08-10 06:40:45 on dist-test-slave-bw88"
server_key: "b380602a994a4802490b158ba8ddbc08"
server_key_iv: "5e06ff3c01e068fefc9219ebe90f85bf"
server_key_version: "encryptionkey@0"
I20260810 06:40:45.878937 2814 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:45.879665 2833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:45.879837 2814 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:45.879956 2814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "fa9c31c8738345f8a2dfc2e67d7ae792"
format_stamp: "Formatted at 2026-08-10 06:40:45 on dist-test-slave-bw88"
server_key: "b380602a994a4802490b158ba8ddbc08"
server_key_iv: "5e06ff3c01e068fefc9219ebe90f85bf"
server_key_version: "encryptionkey@0"
I20260810 06:40:45.880029 2814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:45.888950 2814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:45.891213 2814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:45.891374 2814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:45.895391 2814 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:44059
I20260810 06:40:45.895424 2905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:44059 every 8 connection(s)
I20260810 06:40:45.895757 2814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:45.896602 2906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:45.898937 2906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792: Bootstrap starting.
I20260810 06:40:45.899475 2906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:45.899729 2906 log.cc:824] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:45.900375 2906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792: No bootstrap required, opened a new log
I20260810 06:40:45.901257 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 2814
I20260810 06:40:45.901396 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:45.901608 27814 external_mini_cluster.cc:1428] Setting key 99aa4a00b360622863213fa182f79622
I20260810 06:40:45.902684 2906 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa9c31c8738345f8a2dfc2e67d7ae792" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44059 } }
I20260810 06:40:45.902844 2906 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:45.902882 2906 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa9c31c8738345f8a2dfc2e67d7ae792, State: Initialized, Role: FOLLOWER
I20260810 06:40:45.903064 2906 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa9c31c8738345f8a2dfc2e67d7ae792" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44059 } }
I20260810 06:40:45.903162 2906 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:45.903195 2906 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:45.903249 2906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:45.903892 2906 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa9c31c8738345f8a2dfc2e67d7ae792" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44059 } }
I20260810 06:40:45.904016 2906 leader_election.cc:302] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa9c31c8738345f8a2dfc2e67d7ae792; no voters:
I20260810 06:40:45.904179 2906 leader_election.cc:288] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:45.904222 2913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:45.904371 2913 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [term 1 LEADER]: Becoming Leader. State: Replica: fa9c31c8738345f8a2dfc2e67d7ae792, State: Running, Role: LEADER
I20260810 06:40:45.904422 2906 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:45.904505 2913 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa9c31c8738345f8a2dfc2e67d7ae792" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44059 } }
I20260810 06:40:45.904949 2914 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa9c31c8738345f8a2dfc2e67d7ae792" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa9c31c8738345f8a2dfc2e67d7ae792" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44059 } } }
I20260810 06:40:45.905046 2914 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:45.905249 2915 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa9c31c8738345f8a2dfc2e67d7ae792. Latest consensus state: current_term: 1 leader_uuid: "fa9c31c8738345f8a2dfc2e67d7ae792" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa9c31c8738345f8a2dfc2e67d7ae792" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44059 } } }
I20260810 06:40:45.905407 2915 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:45.905896 2923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:45.906428 2923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:45.908861 2923 catalog_manager.cc:1347] Generated new cluster ID: a20d7a7a9cdb49e39993513ab1cad0f3
I20260810 06:40:45.908912 2923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:40:45 dist-test-slave-bw88 krb5kdc[2800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:45.913663 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:45.902106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37018 (local address 127.27.41.190:44059)
0810 06:40:45.902293 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:45.902301 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:45.902337 (+ 36us) server_negotiation.cc:407] Connection header received
0810 06:40:45.902667 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:45.902673 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:45.902715 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:45.902821 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:45.903649 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:45.904882 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:45.906090 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:45.906726 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:45.907122 (+ 396us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:45.909595 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:45.909599 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:45.909599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:45.909611 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:45.911595 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:45.912037 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:45.912040 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:45.912040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:45.912168 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:45.912391 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:45.912392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:45.912392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:45.912688 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:45.912821 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:45.913187 (+ 366us) server_negotiation.cc:299] Negotiation successful
0810 06:40:45.913307 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":97,"threads_started":1}
I20260810 06:40:45.917728 2923 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:45.918406 2923 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:45.922003 2923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa9c31c8738345f8a2dfc2e67d7ae792: Generated new TSK 0
I20260810 06:40:45.922225 2923 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:40:45.954105 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:44059
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:36117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:46.061218 2942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:46.061430 2942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:46.061455 2942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:46.062603 2942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:46.062677 2942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:46.062727 2942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:46.064229 2942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:44059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:46.064453 2942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:46.064673 2942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:46.070438 2955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:46.070446 2953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:46.070449 2950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:46.070693 2942 server_base.cc:1034] running on GCE node
I20260810 06:40:46.070968 2942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:46.071247 2942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:46.072412 2942 hybrid_clock.cc:648] HybridClock initialized: now 1786344046072393 us; error 61 us; skew 500 ppm
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:46.074928 2942 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:40:46.075346 2942 webserver.cc:460] Webserver started at http://127.27.41.129:33981/ using document root <none> and password file <none>
I20260810 06:40:46.075567 2942 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:46.075631 2942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:46.075773 2942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:46.076809 2942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "8083380179c84ae4beeae338d2be1e63"
format_stamp: "Formatted at 2026-08-10 06:40:46 on dist-test-slave-bw88"
server_key: "7e095c28246fca7a7e9b33e4c069754a"
server_key_iv: "98a99d3c0acc105d3d8c67f2ab7f363d"
server_key_version: "encryptionkey@0"
I20260810 06:40:46.077162 2942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "8083380179c84ae4beeae338d2be1e63"
format_stamp: "Formatted at 2026-08-10 06:40:46 on dist-test-slave-bw88"
server_key: "7e095c28246fca7a7e9b33e4c069754a"
server_key_iv: "98a99d3c0acc105d3d8c67f2ab7f363d"
server_key_version: "encryptionkey@0"
I20260810 06:40:46.078598 2942 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:46.079272 2968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:46.079442 2942 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:46.079553 2942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "8083380179c84ae4beeae338d2be1e63"
format_stamp: "Formatted at 2026-08-10 06:40:46 on dist-test-slave-bw88"
server_key: "7e095c28246fca7a7e9b33e4c069754a"
server_key_iv: "98a99d3c0acc105d3d8c67f2ab7f363d"
server_key_version: "encryptionkey@0"
I20260810 06:40:46.079631 2942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:46.114835 2942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:46.116834 2942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:46.117003 2942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:46.117290 2942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:46.117621 2942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:46.117672 2942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:46.117705 2942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:46.117729 2942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:46.125051 2942 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:33271
I20260810 06:40:46.125175 3124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:33271 every 8 connection(s)
I20260810 06:40:46.125682 2942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:40:46.130595 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 2942
I20260810 06:40:46.130728 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:40:46.130949 27814 external_mini_cluster.cc:1428] Setting key 542376020e45e05054b119ceea435f60
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:46.136242 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:46.126480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:57719 (local address 127.27.41.190:44059)
0810 06:40:46.126555 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:46.126557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:46.126734 (+ 177us) server_negotiation.cc:407] Connection header received
0810 06:40:46.127672 (+ 938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:46.127673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:46.127688 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:46.127739 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:46.128306 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.128990 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.130069 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.130325 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.130404 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:46.132941 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:46.132943 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:46.132944 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:46.132954 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:46.134693 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:46.135190 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:46.135191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:46.135191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:46.135243 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:46.135519 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:46.135519 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:46.135520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:46.135653 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:46.135705 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:46.136081 (+ 376us) server_negotiation.cc:299] Negotiation successful
0810 06:40:46.136166 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 06:40:46.136529 3127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:46.126469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:44059 (local address 127.27.41.129:57719)
0810 06:40:46.126629 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:46.126665 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:46.127578 (+ 913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:46.127791 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:46.127794 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:46.128042 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:46.128229 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:46.128233 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.129091 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.129092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:46.129982 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:46.129985 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.130429 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.130431 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:46.130611 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:46.131251 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:46.131261 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:46.132842 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:46.134783 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:46.134789 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:46.134791 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:46.135116 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:46.135304 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:46.135305 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:46.135305 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:46.135444 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:46.135716 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:46.135723 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:46.135878 (+ 155us) client_negotiation.cc:769] Sending connection context
0810 06:40:46.135998 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 06:40:46.136238 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260810 06:40:46.137115 3125 heartbeater.cc:347] Connected to a master server at 127.27.41.190:44059
I20260810 06:40:46.137209 3125 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:46.137449 3125 heartbeater.cc:511] Master 127.27.41.190:44059 requested a full tablet report, sending...
I20260810 06:40:46.138075 2858 ts_manager.cc:194] Registered new tserver with Master: 8083380179c84ae4beeae338d2be1e63 (127.27.41.129:33271)
I20260810 06:40:46.139039 2858 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:57719
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:40:46.158435 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:44059
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:36117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:46.240103 3130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:46.240307 3130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:46.240334 3130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:46.241497 3130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:46.241568 3130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:46.241616 3130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:46.243175 3130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:44059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:46.243420 3130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:46.243641 3130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:46.248773 3137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:46.248823 3130 server_base.cc:1034] running on GCE node
W20260810 06:40:46.248808 3141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:46.248782 3138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:46.249128 3130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:46.249413 3130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:46.250625 3130 hybrid_clock.cc:648] HybridClock initialized: now 1786344046250610 us; error 27 us; skew 500 ppm
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:46.253218 3130 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:40:46.253687 3130 webserver.cc:460] Webserver started at http://127.27.41.130:33009/ using document root <none> and password file <none>
I20260810 06:40:46.253911 3130 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:46.253976 3130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:46.254124 3130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:46.255136 3130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "b01e3f2e7c824676937f3ab247b08f86"
format_stamp: "Formatted at 2026-08-10 06:40:46 on dist-test-slave-bw88"
server_key: "46c420dcb86d87368c39ddb6d9baf53d"
server_key_iv: "79738edde644a7e2be18cf861287ae13"
server_key_version: "encryptionkey@0"
I20260810 06:40:46.255499 3130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "b01e3f2e7c824676937f3ab247b08f86"
format_stamp: "Formatted at 2026-08-10 06:40:46 on dist-test-slave-bw88"
server_key: "46c420dcb86d87368c39ddb6d9baf53d"
server_key_iv: "79738edde644a7e2be18cf861287ae13"
server_key_version: "encryptionkey@0"
I20260810 06:40:46.256860 3130 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:40:46.257673 3148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:46.257880 3130 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:46.257978 3130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "b01e3f2e7c824676937f3ab247b08f86"
format_stamp: "Formatted at 2026-08-10 06:40:46 on dist-test-slave-bw88"
server_key: "46c420dcb86d87368c39ddb6d9baf53d"
server_key_iv: "79738edde644a7e2be18cf861287ae13"
server_key_version: "encryptionkey@0"
I20260810 06:40:46.258055 3130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:46.264696 3130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:46.266618 3130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:46.266773 3130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:46.266987 3130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:46.267287 3130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:46.267343 3130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:46.267382 3130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:46.267410 3130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:46.273489 3130 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:36467
I20260810 06:40:46.273541 3293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:36467 every 8 connection(s)
I20260810 06:40:46.273869 3130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:46.282940 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:46.274644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:51423 (local address 127.27.41.190:44059)
0810 06:40:46.274727 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:46.274729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:46.274884 (+ 155us) server_negotiation.cc:407] Connection header received
0810 06:40:46.275776 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:46.275777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:46.275788 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:46.275841 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:46.276489 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.277004 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.277983 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.278175 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.278232 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:46.280211 (+ 1979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:46.280212 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:46.280212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:46.280219 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:46.281664 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:46.282012 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:46.282013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:46.282014 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:46.282112 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:46.282342 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:46.282343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:46.282343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:46.282447 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:46.282500 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:46.282779 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 06:40:46.282876 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 06:40:46.283134 3299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:46.274586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:44059 (local address 127.27.41.130:51423)
0810 06:40:46.274765 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:46.274799 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:46.275689 (+ 890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:46.275892 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:46.275895 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:46.276190 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:46.276409 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:46.276414 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.277089 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.277090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:46.277900 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:46.277902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.278254 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.278255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:46.278354 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:46.278796 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:46.278804 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:46.280129 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:46.281731 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:46.281737 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:46.281739 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:46.281941 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:46.282186 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:46.282186 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:46.282187 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:46.282283 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:46.282505 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:46.282509 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:46.282625 (+ 116us) client_negotiation.cc:769] Sending connection context
0810 06:40:46.282706 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 06:40:46.282909 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":113,"threads_started":1}
I20260810 06:40:46.283288 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 3130
I20260810 06:40:46.283403 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:40:46.283625 27814 external_mini_cluster.cc:1428] Setting key 6cee0af69247ad1ca613f79cf390df17
I20260810 06:40:46.283771 3294 heartbeater.cc:347] Connected to a master server at 127.27.41.190:44059
I20260810 06:40:46.283910 3294 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:46.284096 3294 heartbeater.cc:511] Master 127.27.41.190:44059 requested a full tablet report, sending...
I20260810 06:40:46.284538 2858 ts_manager.cc:194] Registered new tserver with Master: b01e3f2e7c824676937f3ab247b08f86 (127.27.41.130:36467)
I20260810 06:40:46.285020 2858 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:51423
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:40:46.308784 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:44059
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:36117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:46.388473 3303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:46.388669 3303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:46.388688 3303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:46.389751 3303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:46.389789 3303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:46.389812 3303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:46.391310 3303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:44059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:46.391554 3303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:46.391786 3303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:46.396898 3316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:46.396916 3313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:46.396919 3314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:46.397202 3303 server_base.cc:1034] running on GCE node
I20260810 06:40:46.397461 3303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:46.397698 3303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:46.398872 3303 hybrid_clock.cc:648] HybridClock initialized: now 1786344046398857 us; error 49 us; skew 500 ppm
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:46.401553 3303 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:40:46.402035 3303 webserver.cc:460] Webserver started at http://127.27.41.131:44593/ using document root <none> and password file <none>
I20260810 06:40:46.402266 3303 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:46.402348 3303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:46.402488 3303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:46.403537 3303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "b6b32b5b88c04792a49f32d59b6071af"
format_stamp: "Formatted at 2026-08-10 06:40:46 on dist-test-slave-bw88"
server_key: "2ca1a9b8468110ed3db2c86af29bda22"
server_key_iv: "36bca0b2fad46c0160d66ed17a2dbc78"
server_key_version: "encryptionkey@0"
I20260810 06:40:46.403942 3303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "b6b32b5b88c04792a49f32d59b6071af"
format_stamp: "Formatted at 2026-08-10 06:40:46 on dist-test-slave-bw88"
server_key: "2ca1a9b8468110ed3db2c86af29bda22"
server_key_iv: "36bca0b2fad46c0160d66ed17a2dbc78"
server_key_version: "encryptionkey@0"
I20260810 06:40:46.405506 3303 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260810 06:40:46.406399 3324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:46.406580 3303 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:46.406666 3303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "b6b32b5b88c04792a49f32d59b6071af"
format_stamp: "Formatted at 2026-08-10 06:40:46 on dist-test-slave-bw88"
server_key: "2ca1a9b8468110ed3db2c86af29bda22"
server_key_iv: "36bca0b2fad46c0160d66ed17a2dbc78"
server_key_version: "encryptionkey@0"
I20260810 06:40:46.406736 3303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:46.423251 3303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:46.424998 3303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:46.425155 3303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:46.425396 3303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:46.425698 3303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:46.425732 3303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:46.425751 3303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:46.425801 3303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:46.432003 3303 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:44093
I20260810 06:40:46.432175 3481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:44093 every 8 connection(s)
I20260810 06:40:46.432404 3303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:40:46.433494 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 3303
I20260810 06:40:46.433584 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:40:46.433760 27814 external_mini_cluster.cc:1428] Setting key 068b83926cab3ac71798e240d8b1f008
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:46.441807 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:46.433192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:38215 (local address 127.27.41.190:44059)
0810 06:40:46.433260 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:46.433262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:46.433559 (+ 297us) server_negotiation.cc:407] Connection header received
0810 06:40:46.434715 (+ 1156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:46.434716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:46.434729 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:46.434783 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:46.435392 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.435881 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.436885 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.437080 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.437154 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:46.439166 (+ 2012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:46.439168 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:46.439168 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:46.439175 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:46.440328 (+ 1153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:46.440753 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:46.440754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:46.440755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:46.440817 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:46.441077 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:46.441078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:46.441078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:46.441203 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:46.441278 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:46.441634 (+ 356us) server_negotiation.cc:299] Negotiation successful
0810 06:40:46.441719 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 06:40:46.442009 3484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:46.433184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:44059 (local address 127.27.41.131:38215)
0810 06:40:46.433397 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:46.433471 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:46.434595 (+ 1124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:46.434849 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:46.434854 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:46.435109 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:46.435290 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:46.435294 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.435983 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.435984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:46.436783 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:46.436785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.437163 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.437164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:46.437291 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:46.437765 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:46.437773 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:46.439071 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:46.440424 (+ 1353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:46.440431 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:46.440433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:46.440654 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:46.440887 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:46.440888 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:46.440888 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:46.441001 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:46.441280 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:46.441287 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:46.441468 (+ 181us) client_negotiation.cc:769] Sending connection context
0810 06:40:46.441594 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 06:40:46.441750 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":86,"threads_started":1}
I20260810 06:40:46.442413 3482 heartbeater.cc:347] Connected to a master server at 127.27.41.190:44059
I20260810 06:40:46.442529 3482 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:46.442703 3482 heartbeater.cc:511] Master 127.27.41.190:44059 requested a full tablet report, sending...
I20260810 06:40:46.443087 2858 ts_manager.cc:194] Registered new tserver with Master: b6b32b5b88c04792a49f32d59b6071af (127.27.41.131:44093)
I20260810 06:40:46.443500 2858 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:38215
I20260810 06:40:46.445245 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/test-admin.keytab.
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:46.462872 27814 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260810 06:40:46.464640 27814 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/krb5cc' of type FILE
W20260810 06:40:46.464639 3489 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:46.463738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47836 (local address 127.27.41.129:33271)
0810 06:40:46.463918 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:46.463923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:46.463936 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:40:46.463964 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:46.463966 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:46.463980 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:46.464050 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:46.464545 (+ 495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47836: BlockingRecv error: recv got EOF from 127.0.0.1:47836 (error 108)
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":92,"threads_started":1}
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:46.465725 27814 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:46.466672 27814 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.129@KRBTEST.COM
I20260810 06:40:46.474484 3489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:46.467170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47850 (local address 127.27.41.129:33271)
0810 06:40:46.467232 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:46.467234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:46.467256 (+ 22us) server_negotiation.cc:407] Connection header received
0810 06:40:46.467317 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:46.467318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:46.467327 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:46.467378 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:46.467775 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.468471 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.469201 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.469560 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.469615 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:46.471820 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:46.471827 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:46.471827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:46.471833 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:46.473333 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:46.473747 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:46.473750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:46.473751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:46.473819 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:46.474019 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:46.474020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:46.474021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:46.474159 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:46.474271 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:46.474350 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 06:40:46.474415 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260810 06:40:46.476260 3489 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:46.475700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47864 (local address 127.27.41.129:33271)
0810 06:40:46.475748 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:46.475750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:46.475782 (+ 32us) server_negotiation.cc:407] Connection header received
0810 06:40:46.475850 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:46.475851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:46.475861 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:46.475926 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:46.476212 (+ 286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47864: BlockingRecv error: recv got EOF from 127.0.0.1:47864 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260810 06:40:46.476406 27814 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/krb5cc' of type FILE
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:46.477414 27814 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:46.478259 27814 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.129@KRBTEST.COM
I20260810 06:40:46.485664 3489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:46.478735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47878 (local address 127.27.41.129:33271)
0810 06:40:46.478787 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:46.478789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:46.478818 (+ 29us) server_negotiation.cc:407] Connection header received
0810 06:40:46.478867 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:46.478867 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:46.478875 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:46.478919 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:46.479255 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.479711 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.480347 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.480528 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.480584 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:46.482869 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:46.482870 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:46.482871 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:46.482878 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:46.484618 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:46.484968 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:46.484969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:46.484969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:46.485029 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:46.485187 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:46.485188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:46.485188 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:46.485280 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:46.485439 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:46.485530 (+ 91us) server_negotiation.cc:299] Negotiation successful
0810 06:40:46.485603 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260810 06:40:46.487318 3489 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:46.486798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47880 (local address 127.27.41.129:33271)
0810 06:40:46.486857 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:46.486858 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:46.486891 (+ 33us) server_negotiation.cc:407] Connection header received
0810 06:40:46.486961 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:46.486962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:46.486969 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:46.487012 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:46.487279 (+ 267us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47880: BlockingRecv error: recv got EOF from 127.0.0.1:47880 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260810 06:40:46.487432 27814 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786344020082892-27814-0/krb5kdc/krb5cc' of type FILE
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:46.488440 27814 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:46.489285 27814 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[2800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344046, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.129@KRBTEST.COM
I20260810 06:40:46.495934 3489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:46.489900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47884 (local address 127.27.41.129:33271)
0810 06:40:46.489951 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:46.489953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:46.490018 (+ 65us) server_negotiation.cc:407] Connection header received
0810 06:40:46.490084 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:46.490084 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:46.490091 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:46.490133 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:46.490522 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.490982 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.491674 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:46.491842 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:46.491887 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:46.493916 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:46.493917 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:46.493917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:46.493923 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:46.495040 (+ 1117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:46.495332 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:46.495333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:46.495333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:46.495380 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:46.495564 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:46.495565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:46.495565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:46.495643 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:46.495706 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:46.495782 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 06:40:46.495832 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 06:40:46.496554 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 2942
I20260810 06:40:46.508630 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 3130
I20260810 06:40:46.516462 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 3303
I20260810 06:40:46.524319 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 2814
2026-08-10T06:40:46Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2051 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[3510](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[3510](info): set up 2 sockets
Aug 10 06:40:46 dist-test-slave-bw88 krb5kdc[3510](info): commencing operation
krb5kdc: starting...
W20260810 06:40:47.717613 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:47 dist-test-slave-bw88 krb5kdc[3510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:47Z Disabled control of system clock
WARNING: no policy specified for oryx/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.190.keytab.
Entry for principal oryx/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.190.keytab.
I20260810 06:40:47.836401 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:34515
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.190.keytab
--principal=oryx/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:34515
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:47.918919 3532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:47.919157 3532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:47.919195 3532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:47.920300 3532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:47.920374 3532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:47.920414 3532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:47.920449 3532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:47.920476 3532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:47.922019 3532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:34515
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.190.keytab
--principal=oryx/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:34515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:47.922305 3532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:47.922555 3532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:47.927671 3540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:47.927749 3539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:47.927758 3542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:47.927889 3532 server_base.cc:1034] running on GCE node
I20260810 06:40:47.928170 3532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:47.928450 3532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:47.929605 3532 hybrid_clock.cc:648] HybridClock initialized: now 1786344047929583 us; error 37 us; skew 500 ppm
Aug 10 06:40:47 dist-test-slave-bw88 krb5kdc[3510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344047, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:47.932194 3532 init.cc:377] Logged in from keytab as oryx/127.27.41.190@KRBTEST.COM (short username oryx)
I20260810 06:40:47.932677 3532 webserver.cc:460] Webserver started at http://127.27.41.190:38491/ using document root <none> and password file <none>
I20260810 06:40:47.932893 3532 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:47.932964 3532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:47.933115 3532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:47.934181 3532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "ef8591fc617145a1bbab82955d0b4ad3"
format_stamp: "Formatted at 2026-08-10 06:40:47 on dist-test-slave-bw88"
server_key: "b0119e2f86ed75f9d581205eb09eec47"
server_key_iv: "7812ba1acfdca3293a7224d286e0150c"
server_key_version: "encryptionkey@0"
I20260810 06:40:47.934589 3532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "ef8591fc617145a1bbab82955d0b4ad3"
format_stamp: "Formatted at 2026-08-10 06:40:47 on dist-test-slave-bw88"
server_key: "b0119e2f86ed75f9d581205eb09eec47"
server_key_iv: "7812ba1acfdca3293a7224d286e0150c"
server_key_version: "encryptionkey@0"
I20260810 06:40:47.935942 3532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:40:47.936616 3550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:47.936769 3532 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:47.936872 3532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "ef8591fc617145a1bbab82955d0b4ad3"
format_stamp: "Formatted at 2026-08-10 06:40:47 on dist-test-slave-bw88"
server_key: "b0119e2f86ed75f9d581205eb09eec47"
server_key_iv: "7812ba1acfdca3293a7224d286e0150c"
server_key_version: "encryptionkey@0"
I20260810 06:40:47.936942 3532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:47.949226 3532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:47.951027 3532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:47.951190 3532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:47.955281 3532 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:34515
I20260810 06:40:47.955312 3622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:34515 every 8 connection(s)
I20260810 06:40:47.955649 3532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:47.956594 3623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:47.958832 3623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3: Bootstrap starting.
I20260810 06:40:47.959414 3623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:47.959719 3623 log.cc:824] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:47.960420 3623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3: No bootstrap required, opened a new log
I20260810 06:40:47.961018 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 3532
I20260810 06:40:47.961124 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:47.961450 27814 external_mini_cluster.cc:1428] Setting key 9a3bb405acc75fd3ffab0a749ab4c66d
I20260810 06:40:47.962740 3623 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } }
I20260810 06:40:47.962917 3623 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:47.962975 3623 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef8591fc617145a1bbab82955d0b4ad3, State: Initialized, Role: FOLLOWER
I20260810 06:40:47.963100 3623 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } }
I20260810 06:40:47.963186 3623 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:47.963231 3623 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:47.963281 3623 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:47.964325 3623 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } }
I20260810 06:40:47.964437 3623 leader_election.cc:302] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef8591fc617145a1bbab82955d0b4ad3; no voters:
I20260810 06:40:47.964596 3623 leader_election.cc:288] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:47.964676 3629 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:47.964818 3629 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [term 1 LEADER]: Becoming Leader. State: Replica: ef8591fc617145a1bbab82955d0b4ad3, State: Running, Role: LEADER
I20260810 06:40:47.964823 3623 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:47.964931 3629 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } }
I20260810 06:40:47.966291 3632 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef8591fc617145a1bbab82955d0b4ad3. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } }
I20260810 06:40:47.966367 3632 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:47.966657 3633 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } }
I20260810 06:40:47.967571 3633 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: This master's current role is: LEADER
W20260810 06:40:47.966902 3648 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:40:47.967628 3648 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:40:47.967702 3649 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:47.967911 3649 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 06:40:47 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
I20260810 06:40:47.969597 3649 catalog_manager.cc:1347] Generated new cluster ID: 06a2d88c4542482e9d6de0a46823d2da
I20260810 06:40:47.969650 3649 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:47.972775 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:47.961952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41690 (local address 127.27.41.190:34515)
0810 06:40:47.962167 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:47.962176 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:47.962216 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:40:47.962701 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:47.962710 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:47.962770 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:47.962931 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:47.963715 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:47.965107 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:47.966210 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:47.966885 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:47.967002 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:47.969735 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:47.969739 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:47.969740 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:47.969752 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:47.971197 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:47.971566 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:47.971569 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:47.971570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:47.971703 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:47.971918 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:47.971919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:47.971919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:47.972166 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:47.972331 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:47.972420 (+ 89us) server_negotiation.cc:299] Negotiation successful
0810 06:40:47.972559 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":103,"threads_started":1}
I20260810 06:40:47.985720 3649 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:47.986266 3649 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:47.990185 3649 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3: Generated new TSK 0
I20260810 06:40:47.990362 3649 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab.
Entry for principal oryx/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab.
I20260810 06:40:48.023968 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:34515
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab
--principal=oryx/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:48.111475 3655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:48.111696 3655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:48.111722 3655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:48.112931 3655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:48.112982 3655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:48.113011 3655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:48.114537 3655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab
--principal=oryx/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:34515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:48.114784 3655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:48.115056 3655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:48.120431 3666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:48.120451 3664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:48.120451 3663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:48.120740 3655 server_base.cc:1034] running on GCE node
I20260810 06:40:48.120994 3655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:48.121297 3655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:48.122521 3655 hybrid_clock.cc:648] HybridClock initialized: now 1786344048122496 us; error 42 us; skew 500 ppm
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:48.125445 3655 init.cc:377] Logged in from keytab as oryx/127.27.41.129@KRBTEST.COM (short username oryx)
I20260810 06:40:48.125941 3655 webserver.cc:460] Webserver started at http://127.27.41.129:34711/ using document root <none> and password file <none>
I20260810 06:40:48.126220 3655 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:48.126300 3655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:48.126463 3655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:48.127611 3655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "ff18abd93df34acca7f1a0ba884fea1d"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "52e6de883b513540ab7be2d7be956a33"
server_key_iv: "968812664f97f42d92fcd951957ad73f"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.128031 3655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "ff18abd93df34acca7f1a0ba884fea1d"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "52e6de883b513540ab7be2d7be956a33"
server_key_iv: "968812664f97f42d92fcd951957ad73f"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.129747 3655 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260810 06:40:48.130558 3674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:48.130734 3655 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:48.130837 3655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "ff18abd93df34acca7f1a0ba884fea1d"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "52e6de883b513540ab7be2d7be956a33"
server_key_iv: "968812664f97f42d92fcd951957ad73f"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.130928 3655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:48.146477 3655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:48.149096 3655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:48.149281 3655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:48.149628 3655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:48.150029 3655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:48.150091 3655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:48.150138 3655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:48.150167 3655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:48.157145 3655 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:38031
I20260810 06:40:48.157198 3832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:38031 every 8 connection(s)
I20260810 06:40:48.157624 3655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:40:48.160210 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 3655
I20260810 06:40:48.160357 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:40:48.160602 27814 external_mini_cluster.cc:1428] Setting key 78ccf4a2117b1f6a8151c8fd94bf4019
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
I20260810 06:40:48.169221 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.158467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:47291 (local address 127.27.41.190:34515)
0810 06:40:48.158553 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.158555 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.158750 (+ 195us) server_negotiation.cc:407] Connection header received
0810 06:40:48.159291 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.159292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.159306 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.159372 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.160384 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.161085 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.162328 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.162562 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.162663 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.165670 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.165672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.165673 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.165684 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.167645 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.168098 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.168100 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.168100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.168174 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.168438 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.168439 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.168439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.168609 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.168689 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.168996 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.169113 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:40:48.169303 3840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.158417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.129:47291)
0810 06:40:48.158606 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.158651 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.159197 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.159434 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.159437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.160048 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.160255 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.160260 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.161213 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.161215 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.162208 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.162212 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.162678 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.162679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.162830 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.163490 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.163502 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.165494 (+ 1992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.167749 (+ 2255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.167756 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.167758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.168017 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.168251 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.168252 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.168252 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.168362 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.168699 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.168706 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.168840 (+ 134us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.168937 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.169095 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":104,"threads_started":1}
I20260810 06:40:48.169898 3833 heartbeater.cc:347] Connected to a master server at 127.27.41.190:34515
I20260810 06:40:48.170035 3833 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:48.170238 3833 heartbeater.cc:511] Master 127.27.41.190:34515 requested a full tablet report, sending...
I20260810 06:40:48.170923 3574 ts_manager.cc:194] Registered new tserver with Master: ff18abd93df34acca7f1a0ba884fea1d (127.27.41.129:38031)
WARNING: no policy specified for oryx/127.27.41.130@KRBTEST.COM; defaulting to no policy
I20260810 06:40:48.171830 3574 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:47291
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab.
Entry for principal oryx/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab.
I20260810 06:40:48.190099 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:34515
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab
--principal=oryx/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:48.274554 3846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:48.274751 3846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:48.274775 3846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:48.275918 3846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:48.275962 3846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:48.275990 3846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:48.277529 3846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab
--principal=oryx/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:34515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:48.277781 3846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:48.278048 3846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:48.283317 3852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:48.283330 3853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:48.283319 3855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:48.283614 3846 server_base.cc:1034] running on GCE node
I20260810 06:40:48.283799 3846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:48.283988 3846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:48.285130 3846 hybrid_clock.cc:648] HybridClock initialized: now 1786344048285116 us; error 31 us; skew 500 ppm
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:48.287685 3846 init.cc:377] Logged in from keytab as oryx/127.27.41.130@KRBTEST.COM (short username oryx)
I20260810 06:40:48.288173 3846 webserver.cc:460] Webserver started at http://127.27.41.130:35227/ using document root <none> and password file <none>
I20260810 06:40:48.288419 3846 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:48.288489 3846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:48.288645 3846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:48.289772 3846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "f90f5fd6adac41ffb8a8dfc12564d74e"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "5289257da84b9d2cb53fd6c44f5637f3"
server_key_iv: "5048331bffb6e41918970f349625e033"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.290154 3846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "f90f5fd6adac41ffb8a8dfc12564d74e"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "5289257da84b9d2cb53fd6c44f5637f3"
server_key_iv: "5048331bffb6e41918970f349625e033"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.291471 3846 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:48.292218 3863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:48.292404 3846 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:48.292514 3846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "f90f5fd6adac41ffb8a8dfc12564d74e"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "5289257da84b9d2cb53fd6c44f5637f3"
server_key_iv: "5048331bffb6e41918970f349625e033"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.292590 3846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:48.306628 3846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:48.308399 3846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:48.308568 3846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:48.308825 3846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:48.309147 3846 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:48.309206 3846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:48.309242 3846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:48.309291 3846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:48.315418 3846 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:39589
I20260810 06:40:48.315475 4023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:39589 every 8 connection(s)
I20260810 06:40:48.315785 3846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
I20260810 06:40:48.324916 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.316543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:37409 (local address 127.27.41.190:34515)
0810 06:40:48.316627 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.316631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.316813 (+ 182us) server_negotiation.cc:407] Connection header received
0810 06:40:48.317282 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.317283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.317294 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.317420 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.318336 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.318860 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.319845 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.320028 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.320081 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.322236 (+ 2155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.322237 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.322237 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.322243 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.323669 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.324012 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.324012 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.324013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.324064 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.324375 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.324376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.324376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.324473 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.324539 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.324787 (+ 248us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.324853 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 06:40:48.325078 4028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.316509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.130:37409)
0810 06:40:48.316671 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.316712 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.317201 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.317489 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.317492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.318063 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.318255 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.318259 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.318947 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.318947 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.319766 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.319768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.320104 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.320105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.320210 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.320659 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.320667 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.322150 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.323738 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.323744 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.323745 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.323947 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.324155 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.324156 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.324157 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.324308 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.324541 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.324547 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.324676 (+ 129us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.324760 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.324883 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":88,"threads_started":1}
I20260810 06:40:48.325543 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 3846
I20260810 06:40:48.325676 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:40:48.325723 4025 heartbeater.cc:347] Connected to a master server at 127.27.41.190:34515
I20260810 06:40:48.325866 4025 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:48.325917 27814 external_mini_cluster.cc:1428] Setting key 78a30f578261b7069f15fcee657c1dd9
I20260810 06:40:48.326066 4025 heartbeater.cc:511] Master 127.27.41.190:34515 requested a full tablet report, sending...
I20260810 06:40:48.326500 3573 ts_manager.cc:194] Registered new tserver with Master: f90f5fd6adac41ffb8a8dfc12564d74e (127.27.41.130:39589)
I20260810 06:40:48.326902 3573 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:37409
WARNING: no policy specified for oryx/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab.
Entry for principal oryx/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab.
I20260810 06:40:48.352229 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:34515
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab
--principal=oryx/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:48.434254 4032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:48.434520 4032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:48.434549 4032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:48.435675 4032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:48.435715 4032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:48.435742 4032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:48.437201 4032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab
--principal=oryx/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:34515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:48.437443 4032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:48.437683 4032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:48.444000 4043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:48.444015 4038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:48.444020 4032 server_base.cc:1034] running on GCE node
W20260810 06:40:48.443966 4037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:48.444361 4032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:48.444617 4032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:48.445755 4032 hybrid_clock.cc:648] HybridClock initialized: now 1786344048445736 us; error 36 us; skew 500 ppm
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:48.448295 4032 init.cc:377] Logged in from keytab as oryx/127.27.41.131@KRBTEST.COM (short username oryx)
I20260810 06:40:48.448769 4032 webserver.cc:460] Webserver started at http://127.27.41.131:45227/ using document root <none> and password file <none>
I20260810 06:40:48.448987 4032 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:48.449082 4032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:48.449229 4032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:48.450277 4032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "46738ea298e7416988668e22f026acd9"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "31780eacfcb20d29fff26ddc5e741570"
server_key_iv: "8dce021f2fbd6ff6107cbecfb3cbf3e8"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.450678 4032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "46738ea298e7416988668e22f026acd9"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "31780eacfcb20d29fff26ddc5e741570"
server_key_iv: "8dce021f2fbd6ff6107cbecfb3cbf3e8"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.452010 4032 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 06:40:48.452808 4051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:48.452998 4032 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:48.453085 4032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "46738ea298e7416988668e22f026acd9"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "31780eacfcb20d29fff26ddc5e741570"
server_key_iv: "8dce021f2fbd6ff6107cbecfb3cbf3e8"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.453140 4032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:48.482038 4032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:48.484390 4032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:48.484527 4032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:48.484717 4032 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:48.485071 4032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:48.485109 4032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:48.485133 4032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:48.485181 4032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:48.491487 4032 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:34003
I20260810 06:40:48.491593 4213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:34003 every 8 connection(s)
I20260810 06:40:48.491890 4032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:40:48.497391 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 4032
I20260810 06:40:48.497517 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:40:48.497738 27814 external_mini_cluster.cc:1428] Setting key 1b522486d6982703d5d847f6745e3f5a
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
I20260810 06:40:48.501694 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.492621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:57823 (local address 127.27.41.190:34515)
0810 06:40:48.492667 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.492669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.492858 (+ 189us) server_negotiation.cc:407] Connection header received
0810 06:40:48.493476 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.493477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.493486 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.493559 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.494560 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.495061 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.496113 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.496386 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.496454 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.499075 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.499076 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.499077 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.499083 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.500406 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.500808 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.500809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.500809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.500862 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.501092 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.501093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.501093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.501203 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.501255 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.501567 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.501632 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:40:48.501843 4217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.492567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.131:57823)
0810 06:40:48.492730 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.492772 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.493309 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.493617 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.493620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.494184 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.494457 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.494462 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.495169 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.495170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.496040 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.496043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.496481 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.496482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.496589 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.497120 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.497128 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.498899 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.500494 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.500500 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.500502 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.500738 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.500923 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.500923 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.500924 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.501035 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.501259 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.501263 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.501431 (+ 168us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.501531 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.501653 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260810 06:40:48.502307 4215 heartbeater.cc:347] Connected to a master server at 127.27.41.190:34515
I20260810 06:40:48.502419 4215 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:48.502604 4215 heartbeater.cc:511] Master 127.27.41.190:34515 requested a full tablet report, sending...
I20260810 06:40:48.502964 3573 ts_manager.cc:194] Registered new tserver with Master: 46738ea298e7416988668e22f026acd9 (127.27.41.131:34003)
I20260810 06:40:48.503332 3573 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:57823
I20260810 06:40:48.509455 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.27.41.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.41.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.41.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.189.keytab.
Entry for principal oryx/127.27.41.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.189.keytab.
I20260810 06:40:48.535753 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.189:33443
--webserver_interface=127.27.41.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.189.keytab
--principal=oryx/127.27.41.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:34515,127.27.41.189:33443
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:48.617511 4220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:48.617708 4220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:48.617730 4220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:48.618824 4220 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:48.618860 4220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:48.618875 4220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:48.618887 4220 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:48.618927 4220 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:48.620298 4220 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:34515,127.27.41.189:33443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.189.keytab
--principal=oryx/127.27.41.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.189:33443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.41.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
W20260810 06:40:48.620393 4220 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.27.41.190:34515,127.27.41.189:33443'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260810 06:40:48.620491 4220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:48.620653 4220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:48.625502 4227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:48.625510 4230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:48.625510 4228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:48.625770 4220 server_base.cc:1034] running on GCE node
I20260810 06:40:48.626022 4220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:48.626351 4220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:48.627524 4220 hybrid_clock.cc:648] HybridClock initialized: now 1786344048627498 us; error 36 us; skew 500 ppm
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:48.630081 4220 init.cc:377] Logged in from keytab as oryx/127.27.41.189@KRBTEST.COM (short username oryx)
I20260810 06:40:48.630517 4220 webserver.cc:460] Webserver started at http://127.27.41.189:41757/ using document root <none> and password file <none>
I20260810 06:40:48.630748 4220 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:48.630816 4220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:48.630980 4220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:48.631979 4220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/data/instance:
uuid: "2dccbbe9b76e45afac26659603b7d0df"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "23930db2eca42c2944ab2378ac5cb162"
server_key_iv: "e544c154739eca395736c5a83e316614"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.632354 4220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/wal/instance:
uuid: "2dccbbe9b76e45afac26659603b7d0df"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "23930db2eca42c2944ab2378ac5cb162"
server_key_iv: "e544c154739eca395736c5a83e316614"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.633836 4220 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260810 06:40:48.634590 4238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:48.634796 4220 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:48.634895 4220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/wal
uuid: "2dccbbe9b76e45afac26659603b7d0df"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "23930db2eca42c2944ab2378ac5cb162"
server_key_iv: "e544c154739eca395736c5a83e316614"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.634987 4220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:48.650169 4220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:48.651983 4220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:48.652146 4220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:48.656525 4220 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.189:33443
I20260810 06:40:48.656562 4315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.189:33443 every 8 connection(s)
I20260810 06:40:48.656956 4220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/data/info.pb
I20260810 06:40:48.658046 4316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:48.659581 4316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:40:48.660398 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 4220
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.189@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.41.189@KRBTEST.COM
I20260810 06:40:48.669430 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.660344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41698 (local address 127.27.41.190:34515)
0810 06:40:48.660416 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.660419 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.660643 (+ 224us) server_negotiation.cc:407] Connection header received
0810 06:40:48.661157 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.661159 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.661172 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.661235 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.661906 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.662423 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.663582 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.663806 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.663884 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.666346 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.666347 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.666347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.666354 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.667844 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.668281 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.668283 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.668283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.668346 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.668600 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.668601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.668601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.668814 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.668890 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.669208 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.669300 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 06:40:48.669570 4320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.660258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:41698)
0810 06:40:48.660509 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.660550 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.661010 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.661305 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.661309 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.661627 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.661799 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.661803 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.662527 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.662528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.663488 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.663490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.663892 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.663893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.664025 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.664531 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.664541 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.666178 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.667946 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.667954 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.667956 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.668201 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.668420 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.668420 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.668421 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.668527 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.668894 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.668900 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.669038 (+ 138us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.669160 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.669324 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":183,"thread_start_us":96,"threads_started":1}
I20260810 06:40:48.670112 4322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.661081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58754 (local address 127.27.41.189:33443)
0810 06:40:48.661284 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.661289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.661423 (+ 134us) server_negotiation.cc:407] Connection header received
0810 06:40:48.661484 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.661488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.661513 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.661614 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.662247 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.663092 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.663830 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.664128 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.664204 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.667064 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.667072 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.667072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.667078 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.668680 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.669058 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.669060 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.669061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.669124 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.669387 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.669388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.669388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.669543 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.669693 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.669921 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.670001 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":144,"threads_started":1}
I20260810 06:40:48.670140 4316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.189@KRBTEST.COM for oryx/127.27.41.189@KRBTEST.COM
I20260810 06:40:48.676055 4320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.670441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:33443 (local address 127.0.0.1:58770)
0810 06:40:48.670540 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.670551 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.670602 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.670729 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.670729 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.670897 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.670928 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.670930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.671518 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.671519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.671967 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.671968 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.672298 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.672299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.672344 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.672675 (+ 331us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.672678 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.673781 (+ 1103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.675300 (+ 1519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.675301 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.675301 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.675461 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.675629 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.675630 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.675630 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.675679 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.675853 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.675854 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.675887 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.675933 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.676001 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260810 06:40:48.676196 4322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.670493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58770 (local address 127.27.41.189:33443)
0810 06:40:48.670540 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.670542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.670587 (+ 45us) server_negotiation.cc:407] Connection header received
0810 06:40:48.670657 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.670657 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.670668 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.670718 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.670999 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.671443 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.672036 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.672235 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.672283 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.673851 (+ 1568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.673852 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.673852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.673858 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.675230 (+ 1372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.675522 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.675523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.675523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.675573 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.675715 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.675715 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.675716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.675808 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.675849 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.675946 (+ 97us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.676051 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":28}
I20260810 06:40:48.677541 4316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: Bootstrap starting.
I20260810 06:40:48.678334 4316 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:48.678589 4316 log.cc:824] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:48.679296 4316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: No bootstrap required, opened a new log
I20260810 06:40:48.680706 4316 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } }
I20260810 06:40:48.680823 4316 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:48.680845 4316 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dccbbe9b76e45afac26659603b7d0df, State: Initialized, Role: FOLLOWER
I20260810 06:40:48.680965 4316 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } }
I20260810 06:40:48.681293 4316 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:48.681242 4324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } } }
I20260810 06:40:48.681385 4324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: This master's current role is: FOLLOWER
W20260810 06:40:48.683046 4338 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:40:48.683107 4338 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:40:48.684873 4220 master_runner.cc:428] Detected that this master 2dccbbe9b76e45afac26659603b7d0df is joining an existing cluster
I20260810 06:40:48.684917 4220 master_runner.cc:432] Initiating AddMaster RPC to add 127.27.41.189:33443
I20260810 06:40:48.693146 4346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.686038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:33443 (local address 127.0.0.1:58786)
0810 06:40:48.686258 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.686272 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.686468 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.686638 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.686639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.686897 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.687019 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.687021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.687907 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.687908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.688827 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.688830 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.689279 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.689280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.689337 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.689709 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.689714 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.690101 (+ 387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.691999 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.692000 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.692000 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.692252 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.692426 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.692427 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.692427 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.692495 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.692742 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.692742 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.692799 (+ 57us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.692885 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.693024 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":29,"thread_start_us":145,"threads_started":1}
I20260810 06:40:48.693194 4322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.686088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58786 (local address 127.27.41.189:33443)
0810 06:40:48.686146 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.686148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.686344 (+ 196us) server_negotiation.cc:407] Connection header received
0810 06:40:48.686550 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.686551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.686562 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.686587 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.687113 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.687824 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.688912 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.689159 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.689236 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.690188 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.690189 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.690189 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.690194 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.691898 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.692321 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.692322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.692322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.692375 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.692546 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.692547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.692547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.692672 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.692748 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.692909 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.693080 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":104,"server-negotiator.queue_time_us":36}
I20260810 06:40:48.693615 4350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.686327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:41706)
0810 06:40:48.686432 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.686442 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.686531 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.686662 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.686662 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.686895 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.687013 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.687014 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.687919 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.687920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.688557 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.688559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.688973 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.688974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.689042 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.689558 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.689564 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.689967 (+ 403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.691863 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.691865 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.691865 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.692171 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.692369 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.692369 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.692370 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.692432 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.693310 (+ 878us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.693311 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.693394 (+ 83us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.693478 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.693550 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":56,"thread_start_us":65,"threads_started":1}
I20260810 06:40:48.694382 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.686394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41706 (local address 127.27.41.190:34515)
0810 06:40:48.686440 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.686442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.686519 (+ 77us) server_negotiation.cc:407] Connection header received
0810 06:40:48.686592 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.686593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.686604 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.686648 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.687097 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.687825 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.688645 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.688890 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.688963 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.690057 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.690059 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.690059 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.690067 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.691771 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.692252 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.692253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.692254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.692315 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.692504 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.692505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.692505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.692667 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.692757 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.694196 (+ 1439us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.694286 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344047, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.190@KRBTEST.COM for oryx/127.27.41.189@KRBTEST.COM
I20260810 06:40:48.704026 4322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.696770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58788 (local address 127.27.41.189:33443)
0810 06:40:48.696807 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.696809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.696932 (+ 123us) server_negotiation.cc:407] Connection header received
0810 06:40:48.697006 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.697006 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.697014 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.697055 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.697589 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.698049 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.699168 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.699336 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.699389 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.701483 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.701485 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.701485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.701492 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.702837 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.703234 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.703236 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.703236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.703293 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.703496 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.703497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.703497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.703603 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.703674 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.703861 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.703939 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:40:48.704068 4351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.696662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:33443 (local address 127.0.0.1:58788)
0810 06:40:48.696820 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.696860 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.696936 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.697068 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.697071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.697455 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.697511 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.697514 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.698141 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.698142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.699083 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.699086 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.699408 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.699410 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.699504 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.699902 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.699908 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.701400 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.702937 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.702944 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.702946 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.703158 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.703362 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.703363 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.703363 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.703429 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.703680 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.703688 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.703737 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.703836 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.703956 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
I20260810 06:40:48.704707 3573 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.27.41.189:33443: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df"
member_type: NON_VOTER
last_known_addr {
host: "127.27.41.189"
port: 33443
}
attrs {
promote: true
}
}
dest_uuid: "ef8591fc617145a1bbab82955d0b4ad3"
cas_config_opid_index: -1
I20260810 06:40:48.705049 3573 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true } }
I20260810 06:40:48.705592 4353 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 2dccbbe9b76e45afac26659603b7d0df (127.27.41.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true } } }
I20260810 06:40:48.705830 4281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:48.706656 4353 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.27.41.189:33443
I20260810 06:40:48.706697 4281 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 FOLLOWER]: Refusing update from remote peer ef8591fc617145a1bbab82955d0b4ad3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 06:40:48.706743 4353 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true } } }
I20260810 06:40:48.706805 4353 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:48.707006 4220 master.cc:537] Master@127.27.41.189:33443 shutting down...
I20260810 06:40:48.707023 4352 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 06:40:48.707723 3552 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260810 06:40:48.708211 3552 consensus_peers.cc:487] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 -> Peer 2dccbbe9b76e45afac26659603b7d0df (127.27.41.189:33443): Couldn't send request to peer 2dccbbe9b76e45afac26659603b7d0df. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 06:40:48.710157 4220 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:48.710265 4220 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:48.710319 4220 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: stopping tablet replica
I20260810 06:40:48.722645 4220 master.cc:552] Master@127.27.41.189:33443 shutdown complete.
I20260810 06:40:48.722711 4220 master_runner.cc:305] Clearing existing system tablet
I20260810 06:40:48.722838 4220 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:48.722899 4220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:48.723529 4220 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:48.724190 4357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:48.724328 4220 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:48.724399 4220 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 06:40:48.724426 4220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/wal
uuid: "2dccbbe9b76e45afac26659603b7d0df"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "23930db2eca42c2944ab2378ac5cb162"
server_key_iv: "e544c154739eca395736c5a83e316614"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.725291 4220 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:48.727020 4220 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 06:40:48.727105 4220 log.cc:1196] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260810 06:40:48.727304 4220 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: Deleting consensus metadata
I20260810 06:40:48.727427 4220 master_runner.cc:315] Copying system tablet from 127.27.41.190:34515
I20260810 06:40:48.728012 4220 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: tablet copy: Beginning tablet copy session from remote peer at address 127.27.41.190:34515
I20260810 06:40:48.734526 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.728378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41722 (local address 127.27.41.190:34515)
0810 06:40:48.728421 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.728423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.728563 (+ 140us) server_negotiation.cc:407] Connection header received
0810 06:40:48.728600 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.728601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.728611 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.728684 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.729052 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.729626 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.730663 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.730840 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.730889 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.731910 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.731912 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.731912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.731919 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.733319 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.733726 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.733726 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.733727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.733778 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.734005 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.734006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.734006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.734115 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.734166 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.734345 (+ 179us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.734427 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:40:48.734549 4363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.728288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:41722)
0810 06:40:48.728471 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.728481 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.728547 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.728689 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.728690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.728895 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.728960 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.728961 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.729705 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.729706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.730579 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.730582 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.730911 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.730912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.731001 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.731421 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.731426 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.731823 (+ 397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.733440 (+ 1617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.733441 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.733441 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.733655 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.733844 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.733844 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.733845 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.733912 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.734179 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.734180 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.734228 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.734318 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.734438 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":90,"threads_started":1}
I20260810 06:40:48.735098 3599 tablet_copy_service.cc:140] P ef8591fc617145a1bbab82955d0b4ad3: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2dccbbe9b76e45afac26659603b7d0df ({username='oryx', principal='oryx/127.27.41.189@KRBTEST.COM'} at 127.0.0.1:41722)
I20260810 06:40:48.735232 3599 tablet_copy_service.cc:161] P ef8591fc617145a1bbab82955d0b4ad3: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2dccbbe9b76e45afac26659603b7d0df at {username='oryx', principal='oryx/127.27.41.189@KRBTEST.COM'} at 127.0.0.1:41722: session id = 2dccbbe9b76e45afac26659603b7d0df-00000000000000000000000000000000
I20260810 06:40:48.735867 3599 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 06:40:48.736503 4220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 06:40:48.737551 4220 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: tablet copy: Starting download of 0 data blocks...
I20260810 06:40:48.737699 4220 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: tablet copy: Starting download of 1 WAL segments...
I20260810 06:40:48.738669 4220 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 06:40:48.739563 3599 tablet_copy_service.cc:342] P ef8591fc617145a1bbab82955d0b4ad3: Request end of tablet copy session 2dccbbe9b76e45afac26659603b7d0df-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.27.41.189@KRBTEST.COM'} at 127.0.0.1:41722
I20260810 06:40:48.739622 3599 tablet_copy_service.cc:433] P ef8591fc617145a1bbab82955d0b4ad3: ending tablet copy session 2dccbbe9b76e45afac26659603b7d0df-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2dccbbe9b76e45afac26659603b7d0df
I20260810 06:40:48.742017 4220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:48.743136 4365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:48.743146 4364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:48.743410 4369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:48.743428 4220 server_base.cc:1034] running on GCE node
I20260810 06:40:48.743590 4220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:48.743755 4220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:48.744887 4220 hybrid_clock.cc:648] HybridClock initialized: now 1786344048744878 us; error 23 us; skew 500 ppm
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:48.746206 4220 init.cc:377] Logged in from keytab as oryx/127.27.41.189@KRBTEST.COM (short username oryx)
I20260810 06:40:48.746462 4220 webserver.cc:460] Webserver started at http://127.27.41.189:43665/ using document root <none> and password file <none>
I20260810 06:40:48.746583 4220 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:48.746618 4220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:48.747241 4220 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:48.747843 4378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:48.747970 4220 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:48.748016 4220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/wal
uuid: "2dccbbe9b76e45afac26659603b7d0df"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "23930db2eca42c2944ab2378ac5cb162"
server_key_iv: "e544c154739eca395736c5a83e316614"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.748070 4220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:48.756599 4220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:48.758133 4220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:48.761356 4220 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.189:33443
I20260810 06:40:48.761713 4455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.189:33443 every 8 connection(s)
I20260810 06:40:48.761741 4220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-1/data/info.pb
I20260810 06:40:48.762459 4456 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:40:48.762898 4456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: Bootstrap starting.
I20260810 06:40:48.765462 4456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:40:48.765717 4456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: Bootstrap complete.
I20260810 06:40:48.765919 4456 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true } }
I20260810 06:40:48.766016 4456 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2dccbbe9b76e45afac26659603b7d0df, State: Initialized, Role: LEARNER
I20260810 06:40:48.766054 4456 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true } }
I20260810 06:40:48.766237 4456 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:48.766242 4463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true } } }
I20260810 06:40:48.766417 4463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: This master's current role is: LEARNER
I20260810 06:40:48.767671 4479 catalog_manager.cc:1259] Loaded cluster ID: 06a2d88c4542482e9d6de0a46823d2da
I20260810 06:40:48.768280 4479 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: loading cluster ID for follower catalog manager: success
I20260810 06:40:48.769055 4479 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: acquiring CA information for follower catalog manager: success
I20260810 06:40:48.769316 4479 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:40:48.778870 4480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.771763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58802 (local address 127.27.41.189:33443)
0810 06:40:48.771881 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.771883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.771895 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:40:48.771920 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.771921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.771932 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.772018 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.772567 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.773594 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.774325 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.774622 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.774706 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.775910 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.775912 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.775912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.775920 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.777608 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.778012 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.778013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.778014 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.778091 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.778297 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.778298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.778298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.778451 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.778561 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.778676 (+ 115us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.778765 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":59,"threads_started":1}
WARNING: no policy specified for oryx/127.27.41.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.41.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.41.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.188.keytab.
Entry for principal oryx/127.27.41.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.188.keytab.
I20260810 06:40:48.808126 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.188:39133
--webserver_interface=127.27.41.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.188.keytab
--principal=oryx/127.27.41.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:34515,127.27.41.189:33443,127.27.41.188:39133
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:48.895761 4483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:48.896000 4483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:48.896041 4483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:48.897251 4483 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:48.897325 4483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:48.897387 4483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:48.897421 4483 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:48.897449 4483 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:48.898944 4483 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:34515,127.27.41.189:33443,127.27.41.188:39133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.188.keytab
--principal=oryx/127.27.41.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.188:39133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.41.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:48.899217 4483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:48.899442 4483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:48.904461 4493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:48.904464 4495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:48.904714 4491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:48.904834 4483 server_base.cc:1034] running on GCE node
I20260810 06:40:48.905103 4483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:48.905453 4483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:48.906620 4483 hybrid_clock.cc:648] HybridClock initialized: now 1786344048906594 us; error 38 us; skew 500 ppm
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:48.909096 4483 init.cc:377] Logged in from keytab as oryx/127.27.41.188@KRBTEST.COM (short username oryx)
I20260810 06:40:48.909588 4483 webserver.cc:460] Webserver started at http://127.27.41.188:46519/ using document root <none> and password file <none>
I20260810 06:40:48.909812 4483 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:48.909880 4483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:48.910030 4483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:48.911078 4483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/data/instance:
uuid: "65c1309dcd1642de96ea37b06142fcbb"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "f089f24691f214ed23b72f3e40d8b699"
server_key_iv: "f78b28599143d8e7dc5bf1bda28034c1"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.911456 4483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/wal/instance:
uuid: "65c1309dcd1642de96ea37b06142fcbb"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "f089f24691f214ed23b72f3e40d8b699"
server_key_iv: "f78b28599143d8e7dc5bf1bda28034c1"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.912814 4483 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:40:48.913672 4505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:48.913846 4483 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:48.913955 4483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/wal
uuid: "65c1309dcd1642de96ea37b06142fcbb"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "f089f24691f214ed23b72f3e40d8b699"
server_key_iv: "f78b28599143d8e7dc5bf1bda28034c1"
server_key_version: "encryptionkey@0"
I20260810 06:40:48.914029 4483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:48.930301 4483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:48.932204 4483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:48.932309 4483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:48.936415 4483 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.188:39133
I20260810 06:40:48.936453 4583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.188:39133 every 8 connection(s)
I20260810 06:40:48.936776 4483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/data/info.pb
I20260810 06:40:48.937852 4584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:48.939543 4584 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:40:48.943948 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 4483
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.188@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
I20260810 06:40:48.949021 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.940415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41736 (local address 127.27.41.190:34515)
0810 06:40:48.940475 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.940477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.940587 (+ 110us) server_negotiation.cc:407] Connection header received
0810 06:40:48.941062 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.941063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.941072 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.941124 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.941768 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.942256 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.943224 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.943402 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.943450 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.945977 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.945979 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.945979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.945986 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.947562 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.948047 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.948049 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.948049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.948114 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.948369 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.948370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.948370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.948490 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.948566 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.948842 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.948934 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 06:40:48.949193 4586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.940239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:41736)
0810 06:40:48.940448 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.940481 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.940951 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.941186 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.941189 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.941504 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.941691 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.941696 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.942338 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.942339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.943151 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.943153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.943516 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.943517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.943621 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.944113 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.944121 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.945885 (+ 1764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.947622 (+ 1737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.947626 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.947628 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.947965 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.948185 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.948186 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.948186 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.948281 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.948559 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.948566 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.948702 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.948803 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.948948 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":76,"threads_started":1}
I20260810 06:40:48.949748 4584 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.41.188@KRBTEST.COM
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.188@KRBTEST.COM for oryx/127.27.41.189@KRBTEST.COM
I20260810 06:40:48.954346 4589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.944481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57552 (local address 127.27.41.188:39133)
0810 06:40:48.944627 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.944631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.944645 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:40:48.944663 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.944664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.944679 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.944743 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.945447 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.946393 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.947569 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.948002 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.948081 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.950864 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.950872 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.950872 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.950879 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.952583 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.953444 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.953448 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.953448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.953513 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.953722 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.953723 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.953724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.953900 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.954056 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.954133 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.954231 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":86,"threads_started":1}
I20260810 06:40:48.957258 4480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.950107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58806 (local address 127.27.41.189:33443)
0810 06:40:48.950165 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.950167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.950213 (+ 46us) server_negotiation.cc:407] Connection header received
0810 06:40:48.950301 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.950302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.950314 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.950352 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.950637 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.951166 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.952208 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.952407 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.952485 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.954422 (+ 1937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.954424 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.954424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.954433 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.955978 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.956390 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.956391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.956391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.956477 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.956787 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.956787 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.956788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.956905 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.956968 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.957121 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.957197 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 06:40:48.957279 4586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.950035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:33443 (local address 127.0.0.1:58806)
0810 06:40:48.950164 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.950175 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.950240 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.950366 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.950366 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.950509 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.950559 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.950561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.951303 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.951304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.952123 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.952126 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.952502 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.952504 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.952583 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.952988 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.952993 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.954323 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.956055 (+ 1732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.956056 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.956056 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.956262 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.956625 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.956626 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.956626 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.956691 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.956975 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.956976 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.957019 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.957102 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.957195 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260810 06:40:48.957710 4584 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344048, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.188@KRBTEST.COM for oryx/127.27.41.188@KRBTEST.COM
I20260810 06:40:48.963501 4586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.957999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:39133 (local address 127.0.0.1:57562)
0810 06:40:48.958049 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.958060 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.958096 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.958208 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.958208 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.958316 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.958344 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.958345 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.958867 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.958867 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.959310 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.959311 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.959653 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.959654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.959698 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.959993 (+ 295us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.959997 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.961080 (+ 1083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.962627 (+ 1547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.962627 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.962628 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.962785 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.962991 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.962992 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.962992 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.963054 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.963261 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.963262 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.963296 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.963344 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.963421 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 06:40:48.963547 4589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.958049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57562 (local address 127.27.41.188:39133)
0810 06:40:48.958109 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.958111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.958118 (+ 7us) server_negotiation.cc:407] Connection header received
0810 06:40:48.958137 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.958138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.958146 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.958202 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.958384 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.958808 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.959390 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.959571 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.959620 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.961169 (+ 1549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.961171 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.961171 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.961177 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.962541 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.962852 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.962853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.962853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.962900 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.963119 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.963120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.963120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.963208 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.963256 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.963358 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.963467 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":34}
I20260810 06:40:48.964922 4584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: Bootstrap starting.
I20260810 06:40:48.965940 4584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:48.966254 4584 log.cc:824] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:48.967065 4584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: No bootstrap required, opened a new log
I20260810 06:40:48.968719 4584 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } }
I20260810 06:40:48.968859 4584 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:48.968906 4584 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c1309dcd1642de96ea37b06142fcbb, State: Initialized, Role: FOLLOWER
I20260810 06:40:48.969031 4584 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } }
I20260810 06:40:48.969316 4584 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:48.969275 4595 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } } }
I20260810 06:40:48.969408 4595 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: This master's current role is: FOLLOWER
W20260810 06:40:48.971001 4611 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:40:48.971071 4611 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:40:48.973114 4483 master_runner.cc:428] Detected that this master 65c1309dcd1642de96ea37b06142fcbb is joining an existing cluster
I20260810 06:40:48.973165 4483 master_runner.cc:432] Initiating AddMaster RPC to add 127.27.41.188:39133
I20260810 06:40:48.980831 4480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.974345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58822 (local address 127.27.41.189:33443)
0810 06:40:48.974381 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.974384 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.974669 (+ 285us) server_negotiation.cc:407] Connection header received
0810 06:40:48.974715 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.974716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.974727 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.974780 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.975213 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.975866 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.976784 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.977089 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.977125 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.978285 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.978286 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.978287 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.978294 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.979636 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.980016 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.980017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.980018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.980093 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.980303 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.980304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.980304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.980420 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.980504 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.980667 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.980742 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 06:40:48.980851 4622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.974158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:33443 (local address 127.0.0.1:58822)
0810 06:40:48.974594 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.974603 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.974661 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.974831 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.974832 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.975062 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.975124 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.975126 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.975947 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.975948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.976670 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.976671 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.977218 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.977219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.977289 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.977797 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.977802 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.978174 (+ 372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.979726 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.979727 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.979727 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.979923 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.980171 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.980172 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.980172 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.980236 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.980494 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.980495 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.980552 (+ 57us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.980630 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.980739 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":1,"thread_start_us":73,"threads_started":1}
I20260810 06:40:48.993778 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.974176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41742 (local address 127.27.41.190:34515)
0810 06:40:48.974225 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.974227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.974361 (+ 134us) server_negotiation.cc:407] Connection header received
0810 06:40:48.974448 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.974450 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.974460 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.974510 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.974921 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.975690 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.976784 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.977077 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.977122 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.990581 (+ 13459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.990582 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.990583 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.990591 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.992424 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.992929 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.992930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.992930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.993001 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.993182 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.993183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.993183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.993356 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.993422 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.993583 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.993671 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 06:40:48.993815 4620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.974126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:41742)
0810 06:40:48.974293 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.974306 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.974391 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.974513 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.974513 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.974736 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.974830 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.974832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.975775 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.975775 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.976665 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.976668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.977219 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.977219 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.977317 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.990041 (+ 12724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.990046 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.990467 (+ 421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.992548 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.992549 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.992549 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.992845 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.993065 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.993065 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.993066 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.993126 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.993426 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.993427 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.993469 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.993547 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.993679 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":2,"thread_start_us":162,"threads_started":1}
I20260810 06:40:48.993888 4589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.974421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57566 (local address 127.27.41.188:39133)
0810 06:40:48.974451 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.974453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.974790 (+ 337us) server_negotiation.cc:407] Connection header received
0810 06:40:48.974874 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.974874 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.974886 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.974911 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.975359 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.976023 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.977066 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.977367 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.977409 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.990623 (+ 13214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.990625 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.990625 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.990631 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:48.992578 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.993012 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.993014 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.993014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.993074 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:48.993241 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:48.993242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:48.993242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:48.993399 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:48.993457 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:48.993616 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 06:40:48.993776 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":94,"server-negotiator.queue_time_us":16}
I20260810 06:40:48.994004 4621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.974482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:39133 (local address 127.0.0.1:57566)
0810 06:40:48.974746 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.974753 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.974815 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.974960 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.974961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.975205 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.975275 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.975277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.976119 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.976120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.976962 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.976964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.977480 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.977481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.977537 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.989990 (+ 12453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.989995 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.990518 (+ 523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:48.992672 (+ 2154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.992673 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.992673 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.992876 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.993138 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:48.993138 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:48.993139 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:48.993194 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:48.993477 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:48.993478 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:48.993521 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 06:40:48.993642 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 06:40:48.993828 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":60,"threads_started":1}
Aug 10 06:40:48 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344047, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.190@KRBTEST.COM for oryx/127.27.41.188@KRBTEST.COM
I20260810 06:40:49.002516 4351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.996106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:39133 (local address 127.0.0.1:57578)
0810 06:40:48.996154 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:48.996164 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:48.996200 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:48.996310 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:48.996311 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:48.996451 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:48.996526 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.996528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.997085 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.997086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.997641 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:48.997644 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.997997 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.997998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:48.998063 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.998442 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:48.998447 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:48.999862 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:49.001450 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.001451 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.001451 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.001629 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.001842 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.001843 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.001843 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.001906 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.002193 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:49.002194 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:49.002237 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.002327 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.002425 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 06:40:49.002511 4589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:48.996168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57578 (local address 127.27.41.188:39133)
0810 06:40:48.996206 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:48.996208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:48.996230 (+ 22us) server_negotiation.cc:407] Connection header received
0810 06:40:48.996259 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:48.996260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:48.996268 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:48.996309 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:48.996597 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.997004 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.997726 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:48.997928 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:48.997999 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:48.999948 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:48.999949 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:48.999950 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:48.999957 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.001326 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.001704 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.001705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.001705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.001764 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.001977 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.001978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.001978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.002104 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.002164 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.002352 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.002423 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 06:40:49.002949 3573 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.27.41.188:39133: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb"
member_type: NON_VOTER
last_known_addr {
host: "127.27.41.188"
port: 39133
}
attrs {
promote: true
}
}
dest_uuid: "ef8591fc617145a1bbab82955d0b4ad3"
cas_config_opid_index: 5
I20260810 06:40:49.003223 3573 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } }
I20260810 06:40:49.003721 4352 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 65c1309dcd1642de96ea37b06142fcbb (127.27.41.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } } }
I20260810 06:40:49.003806 4538 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:49.004626 4352 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.27.41.188:39133
I20260810 06:40:49.004716 4352 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } } }
I20260810 06:40:49.004786 4352 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:49.004822 4538 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 1 FOLLOWER]: Refusing update from remote peer ef8591fc617145a1bbab82955d0b4ad3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 06:40:49.005036 4483 master.cc:537] Master@127.27.41.188:39133 shutting down...
I20260810 06:40:49.005121 4353 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 06:40:49.006438 3554 consensus_peers.cc:487] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 -> Peer 65c1309dcd1642de96ea37b06142fcbb (127.27.41.188:39133): Couldn't send request to peer 65c1309dcd1642de96ea37b06142fcbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 06:40:49.008100 4483 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:49.008198 4483 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:49.008253 4483 tablet_replica.cc:330] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: stopping tablet replica
I20260810 06:40:49.010004 4351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.003631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:33443 (local address 127.0.0.1:58830)
0810 06:40:49.006111 (+ 2480us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.006122 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.006173 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.006391 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.006392 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.006393 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:49.006427 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.006428 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.007340 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.007341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.008843 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.008846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.009760 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.009761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.009823 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.009844 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.009894 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.009939 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2463}
I20260810 06:40:49.010241 4480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.003718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58830 (local address 127.27.41.189:33443)
0810 06:40:49.003759 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.003761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.006228 (+ 2467us) server_negotiation.cc:407] Connection header received
0810 06:40:49.006259 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.006261 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.006284 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.006338 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:49.006497 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.007241 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.008961 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.009576 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.009659 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.009726 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.010141 (+ 415us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.010179 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:40:49.010456 4416 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 LEARNER]: Refusing update from remote peer ef8591fc617145a1bbab82955d0b4ad3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 06:40:49.010737 4353 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 06:40:49.011399 4416 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 65c1309dcd1642de96ea37b06142fcbb (127.27.41.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } } }
I20260810 06:40:49.012573 4353 raft_consensus.cc:1050] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3: attempting to promote NON_VOTER 2dccbbe9b76e45afac26659603b7d0df to VOTER
I20260810 06:40:49.012617 4463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef8591fc617145a1bbab82955d0b4ad3. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } } }
I20260810 06:40:49.012701 4463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: This master's current role is: LEARNER
I20260810 06:40:49.012753 4625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: NON_VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: true } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } } }
I20260810 06:40:49.012825 4625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: This master's current role is: LEARNER
I20260810 06:40:49.012795 4353 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } }
I20260810 06:40:49.013335 4351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.013192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:39133 (local address 127.0.0.1:57598)
0810 06:40:49.013242 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.013308 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:39133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 06:40:49.013535 4416 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 LEARNER]: Refusing update from remote peer ef8591fc617145a1bbab82955d0b4ad3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 06:40:49.013685 4351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.013608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:39133 (local address 127.0.0.1:57612)
0810 06:40:49.013642 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.013662 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:39133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260810 06:40:49.013706 4352 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260810 06:40:49.013790 3554 consensus_peers.cc:487] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 -> Peer 65c1309dcd1642de96ea37b06142fcbb (127.27.41.188:39133): Couldn't send request to peer 65c1309dcd1642de96ea37b06142fcbb. Status: Network error: Client connection negotiation failed: client connection to 127.27.41.188:39133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 06:40:49.014290 4626 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2dccbbe9b76e45afac26659603b7d0df (127.27.41.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } } }
I20260810 06:40:49.014446 4416 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2dccbbe9b76e45afac26659603b7d0df (127.27.41.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } } }
I20260810 06:40:49.015125 4626 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } } }
I20260810 06:40:49.015174 4352 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } } }
I20260810 06:40:49.015211 4626 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:49.015249 4352 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:49.015479 4625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } } }
I20260810 06:40:49.015575 4625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:40:49.021612 4483 master.cc:552] Master@127.27.41.188:39133 shutdown complete.
I20260810 06:40:49.021651 4483 master_runner.cc:305] Clearing existing system tablet
I20260810 06:40:49.021796 4483 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:49.021837 4483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:49.022480 4483 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:49.023002 4629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:49.023124 4483 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:49.023180 4483 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:49.023204 4483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/wal
uuid: "65c1309dcd1642de96ea37b06142fcbb"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "f089f24691f214ed23b72f3e40d8b699"
server_key_iv: "f78b28599143d8e7dc5bf1bda28034c1"
server_key_version: "encryptionkey@0"
I20260810 06:40:49.023854 4483 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:49.025013 4483 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 06:40:49.025077 4483 log.cc:1196] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260810 06:40:49.025296 4483 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: Deleting consensus metadata
I20260810 06:40:49.025490 4483 master_runner.cc:315] Copying system tablet from 127.27.41.190:34515
I20260810 06:40:49.026142 4483 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: tablet copy: Beginning tablet copy session from remote peer at address 127.27.41.190:34515
I20260810 06:40:49.032429 4639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.026428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:41752)
0810 06:40:49.026599 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.026609 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.026663 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.026787 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.026787 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.026936 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:49.026993 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.026995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.027889 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.027890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.028382 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.028384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.028839 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.028840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.028892 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.029440 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:49.029446 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:49.029751 (+ 305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:49.031507 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.031508 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.031509 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.031679 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.031886 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.031887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.031887 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.031938 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.032195 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:49.032196 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:49.032231 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.032282 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.032360 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":71,"threads_started":1}
I20260810 06:40:49.032495 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.026482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41752 (local address 127.27.41.190:34515)
0810 06:40:49.026525 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.026527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.026675 (+ 148us) server_negotiation.cc:407] Connection header received
0810 06:40:49.026706 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.026707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.026718 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.026783 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.027058 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.027798 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.028460 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.028744 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.028834 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.029851 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.029853 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.029854 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.029861 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.031424 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.031753 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.031754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.031754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.031819 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.032001 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.032002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.032002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.032132 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.032201 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.032327 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.032406 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:40:49.032740 3599 tablet_copy_service.cc:140] P ef8591fc617145a1bbab82955d0b4ad3: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 65c1309dcd1642de96ea37b06142fcbb ({username='oryx', principal='oryx/127.27.41.188@KRBTEST.COM'} at 127.0.0.1:41752)
I20260810 06:40:49.032788 3599 tablet_copy_service.cc:161] P ef8591fc617145a1bbab82955d0b4ad3: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 65c1309dcd1642de96ea37b06142fcbb at {username='oryx', principal='oryx/127.27.41.188@KRBTEST.COM'} at 127.0.0.1:41752: session id = 65c1309dcd1642de96ea37b06142fcbb-00000000000000000000000000000000
I20260810 06:40:49.033373 3599 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 06:40:49.033928 4483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 06:40:49.034972 4483 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: tablet copy: Starting download of 0 data blocks...
I20260810 06:40:49.035166 4483 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: tablet copy: Starting download of 1 WAL segments...
I20260810 06:40:49.036041 4483 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 06:40:49.036811 3599 tablet_copy_service.cc:342] P ef8591fc617145a1bbab82955d0b4ad3: Request end of tablet copy session 65c1309dcd1642de96ea37b06142fcbb-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.27.41.188@KRBTEST.COM'} at 127.0.0.1:41752
I20260810 06:40:49.036877 3599 tablet_copy_service.cc:433] P ef8591fc617145a1bbab82955d0b4ad3: ending tablet copy session 65c1309dcd1642de96ea37b06142fcbb-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 65c1309dcd1642de96ea37b06142fcbb
I20260810 06:40:49.039552 4483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:49.040810 4641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:49.040856 4644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:49.041062 4483 server_base.cc:1034] running on GCE node
W20260810 06:40:49.041540 4642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:49.041684 4483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:49.041834 4483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:49.042948 4483 hybrid_clock.cc:648] HybridClock initialized: now 1786344049042934 us; error 28 us; skew 500 ppm
Aug 10 06:40:49 dist-test-slave-bw88 krb5kdc[3510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344049, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:49.044487 4483 init.cc:377] Logged in from keytab as oryx/127.27.41.188@KRBTEST.COM (short username oryx)
I20260810 06:40:49.044765 4483 webserver.cc:460] Webserver started at http://127.27.41.188:45115/ using document root <none> and password file <none>
I20260810 06:40:49.044893 4483 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:49.044945 4483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:49.045888 4483 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:49.053452 4653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:49.053572 4483 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.000s sys 0.001s
I20260810 06:40:49.053611 4483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/wal
uuid: "65c1309dcd1642de96ea37b06142fcbb"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "f089f24691f214ed23b72f3e40d8b699"
server_key_iv: "f78b28599143d8e7dc5bf1bda28034c1"
server_key_version: "encryptionkey@0"
I20260810 06:40:49.053671 4483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:49.100586 4483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:49.102842 4483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:49.106308 4483 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.188:39133
I20260810 06:40:49.106455 4725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.188:39133 every 8 connection(s)
I20260810 06:40:49.106670 4483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/master-2/data/info.pb
I20260810 06:40:49.107436 4726 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:40:49.107847 4726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: Bootstrap starting.
I20260810 06:40:49.110416 4726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:40:49.110853 4726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: Bootstrap complete.
I20260810 06:40:49.111128 4726 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } }
I20260810 06:40:49.111248 4726 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65c1309dcd1642de96ea37b06142fcbb, State: Initialized, Role: LEARNER
I20260810 06:40:49.111295 4726 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } }
I20260810 06:40:49.111555 4726 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:49.111527 4732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } } }
I20260810 06:40:49.111754 4732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: This master's current role is: LEARNER
I20260810 06:40:49.114387 4751 catalog_manager.cc:1259] Loaded cluster ID: 06a2d88c4542482e9d6de0a46823d2da
I20260810 06:40:49.114483 4751 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: loading cluster ID for follower catalog manager: success
I20260810 06:40:49.115630 4751 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: acquiring CA information for follower catalog manager: success
I20260810 06:40:49.116029 4751 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:40:49.120148 4730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.111264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57636 (local address 127.27.41.188:39133)
0810 06:40:49.111399 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.111402 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.111411 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:49.111436 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.111437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.111449 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.112355 (+ 906us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.112396 (+ 41us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.113478 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.114482 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.114781 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.115116 (+ 335us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.116857 (+ 1741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.116859 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.116859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.116867 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.118854 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.119273 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.119274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.119274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.119352 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.119554 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.119555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.119556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.119698 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.119800 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.119919 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.120034 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260810 06:40:49.123880 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 3655
I20260810 06:40:49.141878 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:38031
--local_ip_for_outbound_sockets=127.27.41.129
--tserver_master_addrs=127.27.41.190:34515
--webserver_port=34711
--webserver_interface=127.27.41.129
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab
--principal=oryx/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.27.41.190:34515,127.27.41.189:33443
--tserver_master_addrs=127.27.41.190:34515,127.27.41.189:33443,127.27.41.188:39133 with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:49.232286 4752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:49.232510 4752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:49.232550 4752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:49.233721 4752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:49.233788 4752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:49.233831 4752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:49.235343 4752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab
--principal=oryx/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:38031
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=34711
--tserver_master_addrs=127.27.41.190:34515,127.27.41.189:33443,127.27.41.188:39133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:49.235595 4752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:49.235824 4752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:49.240834 4761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:49.240906 4759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:49.240906 4758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:49.241122 4752 server_base.cc:1034] running on GCE node
I20260810 06:40:49.241417 4752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:49.241719 4752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:49.242871 4752 hybrid_clock.cc:648] HybridClock initialized: now 1786344049242860 us; error 30 us; skew 500 ppm
Aug 10 06:40:49 dist-test-slave-bw88 krb5kdc[3510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344049, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:49.245187 4752 init.cc:377] Logged in from keytab as oryx/127.27.41.129@KRBTEST.COM (short username oryx)
I20260810 06:40:49.245668 4752 webserver.cc:460] Webserver started at http://127.27.41.129:34711/ using document root <none> and password file <none>
I20260810 06:40:49.245903 4752 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:49.245983 4752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:49.247287 4752 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:49.247895 4769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:49.248042 4752 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:49.248122 4752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "ff18abd93df34acca7f1a0ba884fea1d"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "52e6de883b513540ab7be2d7be956a33"
server_key_iv: "968812664f97f42d92fcd951957ad73f"
server_key_version: "encryptionkey@0"
I20260810 06:40:49.248449 4752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:49.256132 4752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:49.257962 4752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:49.258071 4752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:49.258292 4752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:49.258554 4752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:49.258586 4752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:49.258605 4752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:49.258617 4752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:49.264869 4752 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:38031
I20260810 06:40:49.264919 4925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:38031 every 8 connection(s)
I20260810 06:40:49.265255 4752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:40:49.268455 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 4752
I20260810 06:40:49.268618 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 3846
Aug 10 06:40:49 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344049, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
Aug 10 06:40:49 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344049, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.188@KRBTEST.COM
Aug 10 06:40:49 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344049, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.189@KRBTEST.COM
I20260810 06:40:49.279196 4730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.266186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:37299 (local address 127.27.41.188:39133)
0810 06:40:49.266306 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.266308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.266395 (+ 87us) server_negotiation.cc:407] Connection header received
0810 06:40:49.267201 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.267202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.267215 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.267266 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.268083 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.268837 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.270365 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.270714 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.270752 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.274857 (+ 4105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.274858 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.274859 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.274867 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.277131 (+ 2264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.277649 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.277651 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.277651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.277732 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.278056 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.278058 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.278058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.278215 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.278273 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.278971 (+ 698us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.279079 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260810 06:40:49.279502 4480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.266239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:42603 (local address 127.27.41.189:33443)
0810 06:40:49.266351 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.266353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.266529 (+ 176us) server_negotiation.cc:407] Connection header received
0810 06:40:49.267321 (+ 792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.267322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.267331 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.267391 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.268073 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.268795 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.270491 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.270895 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.270947 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.275164 (+ 4217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.275165 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.275165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.275173 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.277993 (+ 2820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.278557 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.278558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.278558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.278613 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.278825 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.278826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.278827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.278989 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.279034 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.279292 (+ 258us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.279388 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260810 06:40:49.280098 4932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.266035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:33443 (local address 127.27.41.129:42603)
0810 06:40:49.266443 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.266452 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.266929 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.267411 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.267412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.267750 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:49.267967 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.267971 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.268919 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.268921 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.270350 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.270353 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.271058 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.271059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.271142 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.271874 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:49.271879 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:49.274739 (+ 2860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:49.278089 (+ 3350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.278090 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.278090 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.278305 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.278691 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.278691 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.278692 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.278748 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.279088 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:49.279089 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:49.279126 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.279631 (+ 505us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.279836 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":107,"thread_start_us":107,"threads_started":1}
I20260810 06:40:49.280544 4933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.266035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:39133 (local address 127.27.41.129:37299)
0810 06:40:49.266257 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.266307 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.266917 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.267286 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.267292 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.267749 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:49.267967 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.267973 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.268985 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.268986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.270257 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.270260 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.270826 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.270826 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.270974 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.271662 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:49.271673 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:49.274436 (+ 2763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:49.277238 (+ 2802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.277239 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.277240 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.277557 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.277809 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.277809 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.277810 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.277961 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.278308 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:49.278316 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:49.278687 (+ 371us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.279729 (+ 1042us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.280447 (+ 718us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":683,"thread_start_us":100,"threads_started":1}
I20260810 06:40:49.280669 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.266393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:47893 (local address 127.27.41.190:34515)
0810 06:40:49.266437 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.266439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.266596 (+ 157us) server_negotiation.cc:407] Connection header received
0810 06:40:49.267027 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.267029 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.267043 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.267096 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.268081 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.268817 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.270365 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.270682 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.270724 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.273984 (+ 3260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.273986 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.273986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.273994 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.275936 (+ 1942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.278504 (+ 2568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.278505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.278505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.278588 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.279821 (+ 1233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.279822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.279823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.279963 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.280018 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.280493 (+ 475us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.280578 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 06:40:49.281315 4934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.266327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.129:47893)
0810 06:40:49.266541 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.266551 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.266929 (+ 378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.267509 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.267510 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.267749 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:49.267970 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.267973 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.268931 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.268932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.270257 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.270260 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.270823 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.270824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.270974 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.271746 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:49.271752 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:49.273864 (+ 2112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:49.276023 (+ 2159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.276033 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.276035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.278446 (+ 2411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.278808 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.278809 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.278809 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.278866 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.280055 (+ 1189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:49.280056 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:49.280095 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.281163 (+ 1068us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.281249 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":166,"thread_start_us":59,"threads_started":1}
I20260810 06:40:49.281690 4927 heartbeater.cc:347] Connected to a master server at 127.27.41.190:34515
I20260810 06:40:49.281771 4927 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:49.281944 4927 heartbeater.cc:511] Master 127.27.41.190:34515 requested a full tablet report, sending...
I20260810 06:40:49.282289 3573 ts_manager.cc:194] Re-registered known tserver with Master: ff18abd93df34acca7f1a0ba884fea1d (127.27.41.129:38031)
I20260810 06:40:49.282750 3573 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:47893
I20260810 06:40:49.286182 4930 heartbeater.cc:347] Connected to a master server at 127.27.41.189:33443
I20260810 06:40:49.286242 4930 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:49.286322 4930 heartbeater.cc:511] Master 127.27.41.189:33443 requested a full tablet report, sending...
I20260810 06:40:49.286532 4926 heartbeater.cc:347] Connected to a master server at 127.27.41.188:39133
I20260810 06:40:49.286628 4926 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:49.286737 4926 heartbeater.cc:511] Master 127.27.41.188:39133 requested a full tablet report, sending...
I20260810 06:40:49.286820 4401 ts_manager.cc:194] Registered new tserver with Master: ff18abd93df34acca7f1a0ba884fea1d (127.27.41.129:38031)
I20260810 06:40:49.287292 4675 ts_manager.cc:194] Registered new tserver with Master: ff18abd93df34acca7f1a0ba884fea1d (127.27.41.129:38031)
I20260810 06:40:49.292238 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:39589
--local_ip_for_outbound_sockets=127.27.41.130
--tserver_master_addrs=127.27.41.190:34515
--webserver_port=35227
--webserver_interface=127.27.41.130
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab
--principal=oryx/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.27.41.190:34515,127.27.41.189:33443
--tserver_master_addrs=127.27.41.190:34515,127.27.41.189:33443,127.27.41.188:39133 with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:49.376164 4939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:49.376350 4939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:49.376374 4939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:49.377578 4939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:49.377620 4939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:49.377646 4939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:49.379196 4939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab
--principal=oryx/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:39589
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=35227
--tserver_master_addrs=127.27.41.190:34515,127.27.41.189:33443,127.27.41.188:39133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:49.379385 4939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:49.379560 4939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:49.384653 4945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:49.384655 4948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:49.384918 4939 server_base.cc:1034] running on GCE node
W20260810 06:40:49.384655 4946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:49.385187 4939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:49.385490 4939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:49.386670 4939 hybrid_clock.cc:648] HybridClock initialized: now 1786344049386654 us; error 32 us; skew 500 ppm
Aug 10 06:40:49 dist-test-slave-bw88 krb5kdc[3510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344049, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:49.389410 4939 init.cc:377] Logged in from keytab as oryx/127.27.41.130@KRBTEST.COM (short username oryx)
I20260810 06:40:49.389832 4939 webserver.cc:460] Webserver started at http://127.27.41.130:35227/ using document root <none> and password file <none>
I20260810 06:40:49.390089 4939 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:49.390172 4939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:49.391505 4939 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:49.392095 4956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:49.392279 4939 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:49.392369 4939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "f90f5fd6adac41ffb8a8dfc12564d74e"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "5289257da84b9d2cb53fd6c44f5637f3"
server_key_iv: "5048331bffb6e41918970f349625e033"
server_key_version: "encryptionkey@0"
I20260810 06:40:49.392705 4939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:49.414806 4939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:49.416447 4730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.413964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57640 (local address 127.27.41.188:39133)
0810 06:40:49.414016 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.414018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.414030 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:40:49.414062 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.414063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.414095 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.414169 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:49.414329 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.414803 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.415714 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.416112 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.416200 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.416269 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.416340 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.416376 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 06:40:49.416455 4351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.413878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:39133 (local address 127.0.0.1:57640)
0810 06:40:49.413947 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.413957 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.414005 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.414175 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.414176 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.414178 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:49.414241 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.414243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.414891 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.414893 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.415618 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.415620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.416207 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.416208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.416270 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.416275 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.416333 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.416380 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 06:40:49.416853 4688 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 06:40:49.417016 4732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef8591fc617145a1bbab82955d0b4ad3. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } } }
I20260810 06:40:49.417157 4732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: This master's current role is: LEARNER
I20260810 06:40:49.417183 4939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:49.417379 4939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:49.417632 4939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:49.417936 4939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:49.417970 4939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:49.417991 4939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:49.418043 4939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:49.423810 4939 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:39589
I20260810 06:40:49.423897 5115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:39589 every 8 connection(s)
I20260810 06:40:49.424240 4939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:40:49.427575 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 4939
I20260810 06:40:49.427757 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 4032
Aug 10 06:40:49 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344049, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.188@KRBTEST.COM
I20260810 06:40:49.440414 4730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.424964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:53025 (local address 127.27.41.188:39133)
0810 06:40:49.425021 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.425023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.425264 (+ 241us) server_negotiation.cc:407] Connection header received
0810 06:40:49.426027 (+ 763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.426028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.426040 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.426069 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.426885 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.427600 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.433873 (+ 6273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.434091 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.434126 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.436582 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.436584 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.436584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.436591 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.438982 (+ 2391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.439436 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.439437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.439437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.439491 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.439748 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.439749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.439749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.439864 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.439901 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.440258 (+ 357us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.440341 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 06:40:49.440934 5120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.424975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:39133 (local address 127.27.41.130:53025)
0810 06:40:49.425131 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.425165 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.425910 (+ 745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.426165 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.426169 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.426590 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:49.426774 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.426780 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.427700 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.427701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.433777 (+ 6076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.433780 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.434205 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.434206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.434320 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.435009 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:49.435018 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:49.436486 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:49.439068 (+ 2582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.439076 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.439078 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.439344 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.439555 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.439555 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.439556 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.439681 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.439944 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:49.439949 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:49.440101 (+ 152us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.440522 (+ 421us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.440710 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":1,"thread_start_us":86,"threads_started":1}
I20260810 06:40:49.441509 5116 heartbeater.cc:347] Connected to a master server at 127.27.41.188:39133
I20260810 06:40:49.441599 5116 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:49.441799 5116 heartbeater.cc:511] Master 127.27.41.188:39133 requested a full tablet report, sending...
Aug 10 06:40:49 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344049, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
I20260810 06:40:49.442246 4675 ts_manager.cc:194] Registered new tserver with Master: f90f5fd6adac41ffb8a8dfc12564d74e (127.27.41.130:39589)
I20260810 06:40:49.446506 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.425311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:51919 (local address 127.27.41.190:34515)
0810 06:40:49.425387 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.425389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.425398 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:49.426024 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.426025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.426038 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.426084 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.426885 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.427612 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.439677 (+ 12065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.439962 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.440000 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.442361 (+ 2361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.442363 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.442364 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.442371 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.444716 (+ 2345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.445317 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.445318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.445319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.445415 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.445714 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.445715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.445716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.445899 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.445987 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.446255 (+ 268us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.446386 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 06:40:49.446941 5121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.425212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.130:51919)
0810 06:40:49.425325 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.425358 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.425910 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.426516 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.426517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.426672 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:49.426774 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.426780 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.427700 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.427701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.439589 (+ 11888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.439591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.440069 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.440069 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.440128 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.440700 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:49.440704 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:49.442230 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:49.444835 (+ 2605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.444836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.444836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.445184 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.445536 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.445537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.445537 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.445619 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.446047 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:49.446049 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:49.446091 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.446594 (+ 503us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.446760 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":72,"threads_started":1}
I20260810 06:40:49.458052 5117 heartbeater.cc:347] Connected to a master server at 127.27.41.190:34515
I20260810 06:40:49.458144 5117 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:49.458256 5117 heartbeater.cc:511] Master 127.27.41.190:34515 requested a full tablet report, sending...
I20260810 06:40:49.458796 3573 ts_manager.cc:194] Re-registered known tserver with Master: f90f5fd6adac41ffb8a8dfc12564d74e (127.27.41.130:39589)
I20260810 06:40:49.459292 3573 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:51919
Aug 10 06:40:49 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344049, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.189@KRBTEST.COM
I20260810 06:40:49.464535 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:34003
--local_ip_for_outbound_sockets=127.27.41.131
--tserver_master_addrs=127.27.41.190:34515
--webserver_port=45227
--webserver_interface=127.27.41.131
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab
--principal=oryx/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.27.41.190:34515,127.27.41.189:33443
--tserver_master_addrs=127.27.41.190:34515,127.27.41.189:33443,127.27.41.188:39133 with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:40:49.465687 4480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.425491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:35013 (local address 127.27.41.189:33443)
0810 06:40:49.425570 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.425572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.425654 (+ 82us) server_negotiation.cc:407] Connection header received
0810 06:40:49.426137 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.426138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.426145 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.426208 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.426887 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.427360 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.459771 (+ 32411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.460129 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.460206 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.462675 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.462677 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.462678 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.462686 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.464348 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.464818 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.464819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.464819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.464873 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.465108 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.465109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.465109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.465221 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.465271 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.465541 (+ 270us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.465622 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:40:49.465802 5122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.425446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:33443 (local address 127.27.41.130:35013)
0810 06:40:49.425592 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.425602 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.425921 (+ 319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.426230 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.426231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.426580 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:49.426773 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.426778 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.427510 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.427511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.459653 (+ 32142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.459657 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.460228 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.460230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.460292 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.460769 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:49.460774 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:49.462584 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:49.464472 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.464473 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.464474 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.464713 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.464942 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.464943 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.464943 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.465020 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.465282 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:49.465283 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:49.465330 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.465485 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.465627 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":111,"threads_started":1}
I20260810 06:40:49.466691 5118 heartbeater.cc:347] Connected to a master server at 127.27.41.189:33443
I20260810 06:40:49.466753 5118 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:49.466846 5118 heartbeater.cc:511] Master 127.27.41.189:33443 requested a full tablet report, sending...
I20260810 06:40:49.467150 4401 ts_manager.cc:194] Registered new tserver with Master: f90f5fd6adac41ffb8a8dfc12564d74e (127.27.41.130:39589)
W20260810 06:40:49.549506 5123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:49.549691 5123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:49.549714 5123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:49.550957 5123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:49.551002 5123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:49.551028 5123 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:49.552603 5123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab
--principal=oryx/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:34003
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=45227
--tserver_master_addrs=127.27.41.190:34515,127.27.41.189:33443,127.27.41.188:39133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:49.552846 5123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:49.553078 5123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:49.558526 5133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:49.558558 5131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:49.558775 5129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:49.558770 5123 server_base.cc:1034] running on GCE node
I20260810 06:40:49.558981 5123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:49.559170 5123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:49.560356 5123 hybrid_clock.cc:648] HybridClock initialized: now 1786344049560348 us; error 28 us; skew 500 ppm
Aug 10 06:40:49 dist-test-slave-bw88 krb5kdc[3510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344049, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:49.562925 5123 init.cc:377] Logged in from keytab as oryx/127.27.41.131@KRBTEST.COM (short username oryx)
I20260810 06:40:49.563391 5123 webserver.cc:460] Webserver started at http://127.27.41.131:45227/ using document root <none> and password file <none>
I20260810 06:40:49.563632 5123 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:49.563716 5123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:49.565212 5123 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:40:49.565917 5141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:49.566100 5123 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 06:40:49.566202 5123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "46738ea298e7416988668e22f026acd9"
format_stamp: "Formatted at 2026-08-10 06:40:48 on dist-test-slave-bw88"
server_key: "31780eacfcb20d29fff26ddc5e741570"
server_key_iv: "8dce021f2fbd6ff6107cbecfb3cbf3e8"
server_key_version: "encryptionkey@0"
I20260810 06:40:49.566562 5123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:49.577041 5123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:49.578841 5123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:49.578995 5123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:49.579218 5123 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:49.579555 5123 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:49.579609 5123 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:49.579651 5123 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:49.579677 5123 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:49.585914 5123 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:34003
I20260810 06:40:49.585963 5307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:34003 every 8 connection(s)
I20260810 06:40:49.586333 5123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:40:49.590538 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 5123
Aug 10 06:40:49 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344049, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
Aug 10 06:40:49 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344049, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.189@KRBTEST.COM
Aug 10 06:40:49 dist-test-slave-bw88 krb5kdc[3510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344049, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.188@KRBTEST.COM
I20260810 06:40:49.600708 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.587697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:41473 (local address 127.27.41.190:34515)
0810 06:40:49.587736 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.587738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.587746 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:40:49.588158 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.588160 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.588171 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.588227 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.588873 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.589628 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.590692 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.590982 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.591026 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.595480 (+ 4454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.595482 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.595482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.595490 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.597908 (+ 2418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.599558 (+ 1650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.599559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.599560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.599622 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.599941 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.599942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.599942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.600090 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.600136 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.600528 (+ 392us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.600614 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 06:40:49.601222 5329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.591997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57642 (local address 127.27.41.188:39133)
0810 06:40:49.593019 (+ 1022us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.593021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.593034 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:40:49.593051 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.593051 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.593060 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.593143 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.594030 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.594780 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.595986 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.596302 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.596356 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.597846 (+ 1490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.597847 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.597848 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.597856 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.599538 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.599973 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.599974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.599974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.600037 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.600240 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.600241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.600241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.600386 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.600479 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.600972 (+ 493us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.601079 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1004,"thread_start_us":54,"threads_started":1}
I20260810 06:40:49.601235 5330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.592352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58832 (local address 127.27.41.189:33443)
0810 06:40:49.592791 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.592813 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.592950 (+ 137us) server_negotiation.cc:407] Connection header received
0810 06:40:49.592983 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.592984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.592997 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.593071 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.593958 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.594736 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.596017 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.596322 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.596385 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.597980 (+ 1595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.597981 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.597981 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.597989 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.599765 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.600144 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.600145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.600146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.600212 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.600414 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.600414 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.600415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.600555 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.600639 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.601051 (+ 412us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.601132 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":61,"threads_started":1}
I20260810 06:40:49.601498 5325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.591810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41756 (local address 127.27.41.190:34515)
0810 06:40:49.593215 (+ 1405us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.593217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.593551 (+ 334us) server_negotiation.cc:407] Connection header received
0810 06:40:49.593577 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.593578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.593591 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.593719 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.594470 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.595209 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.596146 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.596436 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.596511 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.598202 (+ 1691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.598204 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.598204 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.598211 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.599943 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.600327 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.600327 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.600328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.600378 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.600569 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.600570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.600570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.600693 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.600785 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.601249 (+ 464us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.601383 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1385,"thread_start_us":59,"threads_started":1}
I20260810 06:40:49.601635 5316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.587449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.131:41473)
0810 06:40:49.587550 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.587559 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.587935 (+ 376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.588260 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.588261 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.588536 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:49.588761 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.588768 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.589701 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.589702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.590586 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.590589 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.591142 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.591143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.591300 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.591948 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:49.591958 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:49.595331 (+ 3373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:49.598000 (+ 2669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.598007 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.598009 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.599456 (+ 1447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.599698 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.599698 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.599699 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.599857 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.600189 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:49.600197 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:49.600376 (+ 179us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.600972 (+ 596us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.601200 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81,"mutex_wait_us":55,"thread_start_us":59,"threads_started":1}
I20260810 06:40:49.602339 5310 heartbeater.cc:347] Connected to a master server at 127.27.41.190:34515
I20260810 06:40:49.602460 5310 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:49.602675 5310 heartbeater.cc:511] Master 127.27.41.190:34515 requested a full tablet report, sending...
I20260810 06:40:49.603051 3573 ts_manager.cc:194] Re-registered known tserver with Master: 46738ea298e7416988668e22f026acd9 (127.27.41.131:34003)
I20260810 06:40:49.603549 3573 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:41473
I20260810 06:40:49.603192 3574 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41756:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 06:40:49.605744 4730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.587573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:41703 (local address 127.27.41.188:39133)
0810 06:40:49.587646 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.587648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.587660 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:40:49.588033 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.588034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.588047 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.588078 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.588869 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.589624 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.590689 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.590975 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.591023 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.602804 (+ 11781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.602805 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.602805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.602812 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.604482 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.604900 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.604901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.604901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.604955 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.605177 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.605177 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.605178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.605304 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.605389 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.605581 (+ 192us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.605662 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 06:40:49.605773 5315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.587249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:39133 (local address 127.27.41.131:41703)
0810 06:40:49.587366 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.587375 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.587930 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.588566 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.588566 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.588720 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:49.588773 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.588774 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.589718 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.589719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.590583 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.590586 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.591151 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.591153 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.591301 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.592125 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:49.592140 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:49.602714 (+ 10574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:49.604589 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.604590 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.604591 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.604814 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.605032 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.605033 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.605033 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.605091 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.605416 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:49.605417 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:49.605459 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.605548 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.605662 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":76,"threads_started":1}
W20260810 06:40:49.605787 3574 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:49.606043 4480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.587065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:47013 (local address 127.27.41.189:33443)
0810 06:40:49.587154 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.587156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.587420 (+ 264us) server_negotiation.cc:407] Connection header received
0810 06:40:49.588028 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.588037 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.588050 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.588100 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.588854 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.589409 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.590691 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.590993 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.591027 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.602845 (+ 11818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.602846 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.602846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.602853 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.604764 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.605223 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.605224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.605224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.605276 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.605512 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.605513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.605514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.605640 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.605701 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.605889 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.605966 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:40:49.606494 5314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.587051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:33443 (local address 127.27.41.131:47013)
0810 06:40:49.587264 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.587316 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.587918 (+ 602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.588169 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.588174 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.588517 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:49.588760 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.588765 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.589495 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.589496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.590589 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.590590 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.591141 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.591142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.591299 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.592221 (+ 922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:49.592226 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:49.602165 (+ 9939us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:49.604901 (+ 2736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.604902 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.604902 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.605122 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.605370 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:49.605371 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:49.605371 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:49.605437 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:49.605728 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:49.605729 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:49.605766 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.606106 (+ 340us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.606188 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":7,"thread_start_us":114,"threads_started":1}
I20260810 06:40:49.606602 4353 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: NON_VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: true } } }
I20260810 06:40:49.606680 4353 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:49.606868 5309 heartbeater.cc:347] Connected to a master server at 127.27.41.188:39133
I20260810 06:40:49.606927 5309 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:49.607008 5309 heartbeater.cc:511] Master 127.27.41.188:39133 requested a full tablet report, sending...
I20260810 06:40:49.607095 5312 heartbeater.cc:347] Connected to a master server at 127.27.41.189:33443
I20260810 06:40:49.607131 5312 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:49.607172 5312 heartbeater.cc:511] Master 127.27.41.189:33443 requested a full tablet report, sending...
I20260810 06:40:49.607476 4401 ts_manager.cc:194] Registered new tserver with Master: 46738ea298e7416988668e22f026acd9 (127.27.41.131:34003)
I20260810 06:40:49.607791 4675 ts_manager.cc:194] Registered new tserver with Master: 46738ea298e7416988668e22f026acd9 (127.27.41.131:34003)
I20260810 06:40:49.608741 4353 raft_consensus.cc:1050] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3: attempting to promote NON_VOTER 65c1309dcd1642de96ea37b06142fcbb to VOTER
I20260810 06:40:49.609210 4353 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } }
I20260810 06:40:49.609633 4416 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 FOLLOWER]: Refusing update from remote peer ef8591fc617145a1bbab82955d0b4ad3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 06:40:49.609717 4688 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 1 LEARNER]: Refusing update from remote peer ef8591fc617145a1bbab82955d0b4ad3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 06:40:49.609934 5339 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 06:40:49.610075 5333 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 06:40:49.610852 4353 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 65c1309dcd1642de96ea37b06142fcbb (127.27.41.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } } }
I20260810 06:40:49.611102 4416 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 65c1309dcd1642de96ea37b06142fcbb (127.27.41.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } } }
I20260810 06:40:49.611141 4688 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 65c1309dcd1642de96ea37b06142fcbb (127.27.41.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } } }
I20260810 06:40:49.611886 4353 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } } }
I20260810 06:40:49.611971 4353 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:49.612025 4353 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } } }
I20260810 06:40:49.612118 4353 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:49.612162 4353 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } } }
I20260810 06:40:49.612217 4353 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:49.612304 4732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } } }
I20260810 06:40:49.612418 4732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:40:49.612547 5343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ef8591fc617145a1bbab82955d0b4ad3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } } }
I20260810 06:40:49.612643 5343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:40:49.616757 4351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.612898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:38031 (local address 127.0.0.1:49976)
0810 06:40:49.613049 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.613060 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.613100 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.613609 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.613610 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.613612 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:49.613655 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.613657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.614941 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.614942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.615792 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.615795 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.616524 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.616525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.616588 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.616592 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.616653 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.616689 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":48}
I20260810 06:40:49.616786 5347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.613180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49976 (local address 127.27.41.129:38031)
0810 06:40:49.613400 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.613405 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.613417 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:40:49.613463 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.613465 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.613482 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.613601 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:49.613714 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.614852 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.615886 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.616444 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.616518 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.616595 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.616667 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.616708 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":120,"threads_started":1}
I20260810 06:40:49.617596 5344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.613044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:39589 (local address 127.0.0.1:60088)
0810 06:40:49.613877 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.613884 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.613945 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.614129 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.614130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.614132 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:49.614167 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.614169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.615178 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.615179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.616322 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.616325 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.617297 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.617298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.617399 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.617404 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.617469 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.617509 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":818,"mutex_wait_us":4,"thread_start_us":66,"threads_started":1}
I20260810 06:40:49.617739 5346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.613186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41568 (local address 127.27.41.131:34003)
0810 06:40:49.613410 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.613414 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.613553 (+ 139us) server_negotiation.cc:407] Connection header received
0810 06:40:49.613594 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.613596 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.613611 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.613685 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:49.613873 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.615018 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.616414 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.617409 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.617477 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.617550 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.617616 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.617657 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":117,"threads_started":1}
I20260810 06:40:49.617709 5345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.612987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:34003 (local address 127.0.0.1:41568)
0810 06:40:49.613417 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.613429 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.613487 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.613745 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.613746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.613748 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:49.613791 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.613792 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.615115 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.615116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.616323 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.616325 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.617478 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.617479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.617541 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.617545 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.617603 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.617640 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":7,"thread_start_us":100,"threads_started":1}
I20260810 06:40:49.617892 4830 tablet_service.cc:1467] Processing CreateTablet for tablet 4f2f45e5e5c446158dab8b817a54afb7 (DEFAULT_TABLE table=test-table [id=2e1238afaf11482f9bfb7d83c2e382ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:49.618052 5348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.613511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60088 (local address 127.27.41.130:39589)
0810 06:40:49.613711 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.613715 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.613944 (+ 229us) server_negotiation.cc:407] Connection header received
0810 06:40:49.614013 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.614015 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.614036 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.614131 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:49.614224 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.615090 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.616424 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.617217 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.617286 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.617406 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.617780 (+ 374us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.617951 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":86,"threads_started":1}
I20260810 06:40:49.618300 4830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f2f45e5e5c446158dab8b817a54afb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:49.618484 5207 tablet_service.cc:1467] Processing CreateTablet for tablet 4f2f45e5e5c446158dab8b817a54afb7 (DEFAULT_TABLE table=test-table [id=2e1238afaf11482f9bfb7d83c2e382ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:49.618582 5017 tablet_service.cc:1467] Processing CreateTablet for tablet 4f2f45e5e5c446158dab8b817a54afb7 (DEFAULT_TABLE table=test-table [id=2e1238afaf11482f9bfb7d83c2e382ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:49.618806 5207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f2f45e5e5c446158dab8b817a54afb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:49.618856 5017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f2f45e5e5c446158dab8b817a54afb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:49.621214 5349 tablet_bootstrap.cc:492] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d: Bootstrap starting.
I20260810 06:40:49.621845 5349 tablet_bootstrap.cc:654] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:49.622087 5349 log.cc:824] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:49.622282 5351 tablet_bootstrap.cc:492] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e: Bootstrap starting.
I20260810 06:40:49.622884 5351 tablet_bootstrap.cc:654] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:49.623049 5349 tablet_bootstrap.cc:492] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d: No bootstrap required, opened a new log
I20260810 06:40:49.623188 5349 ts_tablet_manager.cc:1397] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:40:49.623234 5351 log.cc:824] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:49.623579 5350 tablet_bootstrap.cc:492] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9: Bootstrap starting.
I20260810 06:40:49.624068 5351 tablet_bootstrap.cc:492] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e: No bootstrap required, opened a new log
I20260810 06:40:49.624150 5351 ts_tablet_manager.cc:1397] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:40:49.624192 5350 tablet_bootstrap.cc:654] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:49.624550 5350 log.cc:824] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:49.625489 5350 tablet_bootstrap.cc:492] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9: No bootstrap required, opened a new log
I20260810 06:40:49.625577 5350 ts_tablet_manager.cc:1397] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:40:49.625949 5349 raft_consensus.cc:348] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } } peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } }
I20260810 06:40:49.626127 5349 raft_consensus.cc:374] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:49.626165 5349 raft_consensus.cc:729] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff18abd93df34acca7f1a0ba884fea1d, State: Initialized, Role: FOLLOWER
I20260810 06:40:49.626307 5349 consensus_queue.cc:260] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } } peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } }
I20260810 06:40:49.626575 5349 ts_tablet_manager.cc:1428] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260810 06:40:49.626598 4927 heartbeater.cc:503] Master 127.27.41.190:34515 was elected leader, sending a full tablet report...
I20260810 06:40:49.626477 5351 raft_consensus.cc:348] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } } peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } }
I20260810 06:40:49.626886 5351 raft_consensus.cc:374] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:49.626938 5351 raft_consensus.cc:729] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f90f5fd6adac41ffb8a8dfc12564d74e, State: Initialized, Role: FOLLOWER
I20260810 06:40:49.627055 5351 consensus_queue.cc:260] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } } peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } }
I20260810 06:40:49.627293 5351 ts_tablet_manager.cc:1428] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 06:40:49.627408 5117 heartbeater.cc:503] Master 127.27.41.190:34515 was elected leader, sending a full tablet report...
I20260810 06:40:49.628687 5350 raft_consensus.cc:348] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } } peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } }
I20260810 06:40:49.628804 5350 raft_consensus.cc:374] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:49.628824 5350 raft_consensus.cc:729] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46738ea298e7416988668e22f026acd9, State: Initialized, Role: FOLLOWER
I20260810 06:40:49.628927 5350 consensus_queue.cc:260] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } } peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } }
I20260810 06:40:49.629132 5350 ts_tablet_manager.cc:1428] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 06:40:49.629196 5310 heartbeater.cc:503] Master 127.27.41.190:34515 was elected leader, sending a full tablet report...
W20260810 06:40:49.675046 5119 tablet.cc:2369] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:40:49.705915 5362 raft_consensus.cc:482] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:49.706045 5362 raft_consensus.cc:504] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } } peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } }
I20260810 06:40:49.706487 5362 leader_election.cc:288] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff18abd93df34acca7f1a0ba884fea1d (127.27.41.129:38031), f90f5fd6adac41ffb8a8dfc12564d74e (127.27.41.130:39589)
I20260810 06:40:49.710503 5347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.706842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:59251 (local address 127.27.41.129:38031)
0810 06:40:49.706890 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.706893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.706902 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:49.706934 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.706934 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.706946 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.707029 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:49.707263 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.708047 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.709585 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.710140 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.710218 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.710227 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.710396 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.710439 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 06:40:49.710539 5348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.706843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:48423 (local address 127.27.41.130:39589)
0810 06:40:49.706890 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.706893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.706903 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:40:49.706957 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.706958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.706966 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.707029 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:49.707259 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.708047 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.709585 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.710139 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.710218 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.710227 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.710396 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.710436 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 06:40:49.710511 5314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.706743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:38031 (local address 127.27.41.131:59251)
0810 06:40:49.706806 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.706818 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.706860 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.707049 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.707049 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.707051 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:49.707173 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.707175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.708132 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.708133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.709486 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.709490 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.710223 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.710224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.710312 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.710318 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.710376 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.710414 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":98}
I20260810 06:40:49.710527 5315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.706751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:39589 (local address 127.27.41.131:48423)
0810 06:40:49.706858 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:49.706867 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:49.706898 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:49.707050 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:49.707050 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:49.707051 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:49.707173 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.707175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.708132 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.708133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.709486 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:49.709490 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.710223 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.710224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:49.710312 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.710318 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:40:49.710376 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 06:40:49.710414 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":168}
I20260810 06:40:49.710927 4859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2f45e5e5c446158dab8b817a54afb7" candidate_uuid: "46738ea298e7416988668e22f026acd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff18abd93df34acca7f1a0ba884fea1d" is_pre_election: true
I20260810 06:40:49.711133 4859 raft_consensus.cc:2454] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46738ea298e7416988668e22f026acd9 in term 0.
I20260810 06:40:49.711064 5044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2f45e5e5c446158dab8b817a54afb7" candidate_uuid: "46738ea298e7416988668e22f026acd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" is_pre_election: true
I20260810 06:40:49.711269 5044 raft_consensus.cc:2454] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46738ea298e7416988668e22f026acd9 in term 0.
I20260810 06:40:49.711364 5143 leader_election.cc:302] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46738ea298e7416988668e22f026acd9, ff18abd93df34acca7f1a0ba884fea1d; no voters:
I20260810 06:40:49.711524 5362 raft_consensus.cc:2781] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:49.711597 5362 raft_consensus.cc:482] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:49.711623 5362 raft_consensus.cc:3037] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:49.712352 5362 raft_consensus.cc:504] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } } peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } }
I20260810 06:40:49.712612 5362 leader_election.cc:288] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [CANDIDATE]: Term 1 election: Requested vote from peers ff18abd93df34acca7f1a0ba884fea1d (127.27.41.129:38031), f90f5fd6adac41ffb8a8dfc12564d74e (127.27.41.130:39589)
I20260810 06:40:49.712695 4859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2f45e5e5c446158dab8b817a54afb7" candidate_uuid: "46738ea298e7416988668e22f026acd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff18abd93df34acca7f1a0ba884fea1d"
I20260810 06:40:49.712795 5044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f2f45e5e5c446158dab8b817a54afb7" candidate_uuid: "46738ea298e7416988668e22f026acd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e"
I20260810 06:40:49.712802 4859 raft_consensus.cc:3037] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:49.712875 5044 raft_consensus.cc:3037] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:49.713837 5044 raft_consensus.cc:2454] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46738ea298e7416988668e22f026acd9 in term 1.
I20260810 06:40:49.713837 4859 raft_consensus.cc:2454] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46738ea298e7416988668e22f026acd9 in term 1.
I20260810 06:40:49.714033 5143 leader_election.cc:302] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46738ea298e7416988668e22f026acd9, ff18abd93df34acca7f1a0ba884fea1d; no voters:
I20260810 06:40:49.714147 5362 raft_consensus.cc:2781] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:49.714318 5362 raft_consensus.cc:686] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [term 1 LEADER]: Becoming Leader. State: Replica: 46738ea298e7416988668e22f026acd9, State: Running, Role: LEADER
I20260810 06:40:49.714430 5362 consensus_queue.cc:237] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } } peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } }
I20260810 06:40:49.715305 3574 catalog_manager.cc:5495] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46738ea298e7416988668e22f026acd9 (127.27.41.131). New cstate: current_term: 1 leader_uuid: "46738ea298e7416988668e22f026acd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } health_report { overall_health: UNKNOWN } } }
I20260810 06:40:49.730676 5346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.728373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41584 (local address 127.27.41.131:34003)
0810 06:40:49.728526 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.728528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.728537 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:49.728574 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.728575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.728594 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.728652 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:49.728797 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.729259 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.730011 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.730195 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.730247 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.730390 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:49.730480 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:49.730538 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.730578 (+ 40us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.730595 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260810 06:40:49.732556 4859 raft_consensus.cc:1261] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d [term 1 FOLLOWER]: Refusing update from remote peer 46738ea298e7416988668e22f026acd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:49.732559 5044 raft_consensus.cc:1261] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e [term 1 FOLLOWER]: Refusing update from remote peer 46738ea298e7416988668e22f026acd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:49.732944 5362 consensus_queue.cc:1035] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:49.733093 5363 consensus_queue.cc:1035] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:49.735796 5368 mvcc.cc:205] Tried to move back new op lower bound from 7316865227701489664 to 7316865227631034368. Current Snapshot: MvccSnapshot[applied={T|T < 7316865227701489664}]
I20260810 06:40:49.736351 5369 mvcc.cc:205] Tried to move back new op lower bound from 7316865227701489664 to 7316865227631034368. Current Snapshot: MvccSnapshot[applied={T|T < 7316865227701489664}]
I20260810 06:40:49.738096 5370 mvcc.cc:205] Tried to move back new op lower bound from 7316865227701489664 to 7316865227631034368. Current Snapshot: MvccSnapshot[applied={T|T < 7316865227701489664}]
I20260810 06:40:49.738406 3574 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:49.738505 3574 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:49.739722 3574 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ef8591fc617145a1bbab82955d0b4ad3: Sending DeleteTablet for 3 replicas of tablet 4f2f45e5e5c446158dab8b817a54afb7
I20260810 06:40:49.740059 5207 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f2f45e5e5c446158dab8b817a54afb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:49 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:41568
I20260810 06:40:49.740330 5017 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f2f45e5e5c446158dab8b817a54afb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:49 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:60088
I20260810 06:40:49.740446 4830 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f2f45e5e5c446158dab8b817a54afb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:49 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:49976
I20260810 06:40:49.740556 5386 tablet_replica.cc:330] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e: stopping tablet replica
I20260810 06:40:49.740653 5386 raft_consensus.cc:2229] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:49.740753 5386 raft_consensus.cc:2258] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:49.740861 5387 tablet_replica.cc:330] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d: stopping tablet replica
I20260810 06:40:49.740954 5387 raft_consensus.cc:2229] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:49.741055 5387 raft_consensus.cc:2258] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:49.741288 5386 ts_tablet_manager.cc:1905] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:49.741520 5387 ts_tablet_manager.cc:1905] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:49.742025 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 3532
I20260810 06:40:49.744860 5386 ts_tablet_manager.cc:1918] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:49.744926 5386 log.cc:1196] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/4f2f45e5e5c446158dab8b817a54afb7
I20260810 06:40:49.745226 5386 ts_tablet_manager.cc:1939] T 4f2f45e5e5c446158dab8b817a54afb7 P f90f5fd6adac41ffb8a8dfc12564d74e: Deleting consensus metadata
I20260810 06:40:49.745383 5387 ts_tablet_manager.cc:1918] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:49.745448 5387 log.cc:1196] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-0/wal/wals/4f2f45e5e5c446158dab8b817a54afb7
I20260810 06:40:49.745754 5387 ts_tablet_manager.cc:1939] T 4f2f45e5e5c446158dab8b817a54afb7 P ff18abd93df34acca7f1a0ba884fea1d: Deleting consensus metadata
I20260810 06:40:49.746114 5383 tablet_replica.cc:330] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9: stopping tablet replica
I20260810 06:40:49.746203 5383 raft_consensus.cc:2229] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:40:49.746273 5383 raft_consensus.cc:2258] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:49.746639 5383 ts_tablet_manager.cc:1905] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:49.748046 5383 ts_tablet_manager.cc:1918] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:49.748111 5383 log.cc:1196] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/4f2f45e5e5c446158dab8b817a54afb7
I20260810 06:40:49.748298 5383 ts_tablet_manager.cc:1939] T 4f2f45e5e5c446158dab8b817a54afb7 P 46738ea298e7416988668e22f026acd9: Deleting consensus metadata
W20260810 06:40:49.758559 4959 connection.cc:535] server connection from 127.0.0.1:60088 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 06:40:49.758580 5147 connection.cc:535] server connection from 127.0.0.1:41568 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 06:40:49.758962 4774 connection.cc:535] server connection from 127.0.0.1:49976 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 06:40:49.769228 4480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.760448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58844 (local address 127.27.41.189:33443)
0810 06:40:49.760497 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.760499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.760679 (+ 180us) server_negotiation.cc:407] Connection header received
0810 06:40:49.760794 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.760795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.760806 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.760877 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.761689 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.762478 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.763621 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.763915 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.763957 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.766059 (+ 2102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.766061 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.766061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.766087 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.767898 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.768395 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.768396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.768397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.768465 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.768664 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.768666 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.768666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.768792 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.768901 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.769039 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.769124 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 06:40:49.769845 4730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:49.760663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57646 (local address 127.27.41.188:39133)
0810 06:40:49.760704 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:49.760706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:49.760716 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:40:49.760800 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:49.760802 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:49.760815 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:49.760847 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:49.761740 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.762478 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.763610 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:49.763915 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:49.763957 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:49.766034 (+ 2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:49.766036 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:49.766036 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:49.766044 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:49.767879 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.768557 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.768559 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.768559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.768617 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:49.768918 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:49.768919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:49.768920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:49.769061 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:49.769137 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:49.769649 (+ 512us) server_negotiation.cc:299] Negotiation successful
0810 06:40:49.769734 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:40:50.737170 5397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:50.736873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.130:55361)
0810 06:40:50.737004 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:50.737104 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":77,"threads_started":1}
W20260810 06:40:50.737504 5117 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:34515 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
I20260810 06:40:50.738314 5399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:50.738011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.131:39679)
0810 06:40:50.738161 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:50.738267 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":98,"threads_started":1}
W20260810 06:40:50.738618 5310 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:34515 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
I20260810 06:40:50.738927 5400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:50.738717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.129:57187)
0810 06:40:50.738824 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:50.738887 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76,"thread_start_us":52,"threads_started":1}
W20260810 06:40:50.739117 4927 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:34515 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
I20260810 06:40:51.240249 5401 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef8591fc617145a1bbab82955d0b4ad3)
I20260810 06:40:51.240406 5401 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } }
I20260810 06:40:51.240729 5401 leader_election.cc:288] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef8591fc617145a1bbab82955d0b4ad3 (127.27.41.190:34515), 2dccbbe9b76e45afac26659603b7d0df (127.27.41.189:33443)
I20260810 06:40:51.241128 5402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.240862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:42252)
0810 06:40:51.241013 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.241074 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":59,"threads_started":1}
I20260810 06:40:51.241201 5408 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef8591fc617145a1bbab82955d0b4ad3)
W20260810 06:40:51.241364 4657 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
I20260810 06:40:51.241410 5408 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } }
I20260810 06:40:51.241706 5408 leader_election.cc:288] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef8591fc617145a1bbab82955d0b4ad3 (127.27.41.190:34515), 65c1309dcd1642de96ea37b06142fcbb (127.27.41.188:39133)
I20260810 06:40:51.241786 5402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.241704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:42266)
0810 06:40:51.241740 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.241764 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260810 06:40:51.241874 4657 leader_election.cc:334] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef8591fc617145a1bbab82955d0b4ad3 (127.27.41.190:34515): Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
I20260810 06:40:51.242063 5410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.241844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:42280)
0810 06:40:51.241973 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.242022 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67,"thread_start_us":46,"threads_started":1}
W20260810 06:40:51.242247 4382 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
I20260810 06:40:51.242722 5410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.242641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:42296)
0810 06:40:51.242675 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.242697 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260810 06:40:51.242861 4382 leader_election.cc:334] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef8591fc617145a1bbab82955d0b4ad3 (127.27.41.190:34515): Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
I20260810 06:40:51.244855 5403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.240885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:33443 (local address 127.0.0.1:58856)
0810 06:40:51.241022 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.241062 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:51.241178 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:51.241483 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:51.241484 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:51.241487 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:51.241576 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:51.241579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.242572 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.242573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:51.243793 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:51.243796 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.244615 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.244616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:51.244678 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:51.244682 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:51.244748 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 06:40:51.244789 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":47,"threads_started":1}
I20260810 06:40:51.244899 5406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.241002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58856 (local address 127.27.41.189:33443)
0810 06:40:51.241179 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:51.241181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:51.241194 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:40:51.241303 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:51.241304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:51.241318 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:51.241434 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:51.241671 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.242461 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.243898 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.244532 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.244600 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:51.244612 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:51.244766 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 06:40:51.244817 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":56,"threads_started":1}
I20260810 06:40:51.245066 4416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65c1309dcd1642de96ea37b06142fcbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2dccbbe9b76e45afac26659603b7d0df" is_pre_election: true
I20260810 06:40:51.245162 4416 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c1309dcd1642de96ea37b06142fcbb in term 1.
I20260810 06:40:51.245229 5412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.242191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57662 (local address 127.27.41.188:39133)
0810 06:40:51.242319 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:51.242321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:51.242450 (+ 129us) server_negotiation.cc:407] Connection header received
0810 06:40:51.242552 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:51.242553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:51.242563 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:51.242606 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:51.242799 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.243366 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.244289 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.244860 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.244922 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:51.244933 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:51.245136 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 06:40:51.245175 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":81,"threads_started":1}
I20260810 06:40:51.245294 4655 leader_election.cc:302] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2dccbbe9b76e45afac26659603b7d0df, 65c1309dcd1642de96ea37b06142fcbb; no voters: ef8591fc617145a1bbab82955d0b4ad3
I20260810 06:40:51.245461 5401 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 06:40:51.245472 5411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.241985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:39133 (local address 127.0.0.1:57662)
0810 06:40:51.242377 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.242387 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:51.242475 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:51.242674 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:51.242674 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:51.242676 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:51.242717 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:51.242719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.243481 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.243482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:51.244187 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:51.244189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.244971 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.244973 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:51.245046 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:51.245052 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:40:51.245328 (+ 276us) client_negotiation.cc:240] Negotiation successful
0810 06:40:51.245395 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":64,"threads_started":1}
I20260810 06:40:51.245505 5401 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef8591fc617145a1bbab82955d0b4ad3)
I20260810 06:40:51.245529 5401 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 1 FOLLOWER]: Advancing to term 2
I20260810 06:40:51.246346 5401 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } }
I20260810 06:40:51.246493 5401 leader_election.cc:288] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [CANDIDATE]: Term 2 election: Requested vote from peers ef8591fc617145a1bbab82955d0b4ad3 (127.27.41.190:34515), 2dccbbe9b76e45afac26659603b7d0df (127.27.41.189:33443)
I20260810 06:40:51.246572 4688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2dccbbe9b76e45afac26659603b7d0df" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "65c1309dcd1642de96ea37b06142fcbb" is_pre_election: true
I20260810 06:40:51.246677 5403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.246576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:42302)
0810 06:40:51.246626 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.246649 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 06:40:51.246687 4688 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2dccbbe9b76e45afac26659603b7d0df in current term 2: Already voted for candidate 65c1309dcd1642de96ea37b06142fcbb in this term.
I20260810 06:40:51.246726 4416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65c1309dcd1642de96ea37b06142fcbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2dccbbe9b76e45afac26659603b7d0df"
I20260810 06:40:51.246791 4416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 1 FOLLOWER]: Advancing to term 2
I20260810 06:40:51.246914 4382 leader_election.cc:302] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2dccbbe9b76e45afac26659603b7d0df; no voters: 65c1309dcd1642de96ea37b06142fcbb, ef8591fc617145a1bbab82955d0b4ad3
I20260810 06:40:51.247025 5403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.246945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:42314)
0810 06:40:51.246981 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.247002 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260810 06:40:51.247076 4657 leader_election.cc:334] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ef8591fc617145a1bbab82955d0b4ad3 (127.27.41.190:34515): Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
I20260810 06:40:51.248157 4416 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c1309dcd1642de96ea37b06142fcbb in term 2.
I20260810 06:40:51.248250 5408 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:40:51.248339 4655 leader_election.cc:302] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2dccbbe9b76e45afac26659603b7d0df, 65c1309dcd1642de96ea37b06142fcbb; no voters: ef8591fc617145a1bbab82955d0b4ad3
I20260810 06:40:51.248440 5401 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 06:40:51.248610 5401 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [term 2 LEADER]: Becoming Leader. State: Replica: 65c1309dcd1642de96ea37b06142fcbb, State: Running, Role: LEADER
I20260810 06:40:51.248685 5401 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } }
I20260810 06:40:51.249028 5416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65c1309dcd1642de96ea37b06142fcbb. Latest consensus state: current_term: 2 leader_uuid: "65c1309dcd1642de96ea37b06142fcbb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } } }
I20260810 06:40:51.249128 5416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:51.249421 5419 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:51.250005 5419 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:51.250102 5419 catalog_manager.cc:1259] Loaded cluster ID: 06a2d88c4542482e9d6de0a46823d2da
I20260810 06:40:51.250137 5419 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:51.250303 5419 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:51.250418 5419 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: Loaded TSK: 0
I20260810 06:40:51.250576 5419 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:40:51.256150 4675 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57646:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:40:51.257972 4675 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:51.258989 4416 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [term 2 FOLLOWER]: Refusing update from remote peer 65c1309dcd1642de96ea37b06142fcbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260810 06:40:51.258991 5403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.258874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:42340)
0810 06:40:51.258928 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.258968 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 06:40:51.259284 5416 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260810 06:40:51.259421 5403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.259322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.0.0.1:42346)
0810 06:40:51.259371 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.259402 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 06:40:51.259526 4657 consensus_peers.cc:487] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb -> Peer ef8591fc617145a1bbab82955d0b4ad3 (127.27.41.190:34515): Couldn't send request to peer ef8591fc617145a1bbab82955d0b4ad3. Status: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 06:40:51.259959 5408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65c1309dcd1642de96ea37b06142fcbb. Latest consensus state: current_term: 2 leader_uuid: "65c1309dcd1642de96ea37b06142fcbb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } } }
I20260810 06:40:51.260066 5408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:40:51.260440 5420 mvcc.cc:205] Tried to move back new op lower bound from 7316865233955016704 to 7316865233915199488. Current Snapshot: MvccSnapshot[applied={T|T < 7316865233955016704}]
I20260810 06:40:51.260558 5401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "65c1309dcd1642de96ea37b06142fcbb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } } }
I20260810 06:40:51.260653 5401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:51.260773 5408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "65c1309dcd1642de96ea37b06142fcbb" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "ef8591fc617145a1bbab82955d0b4ad3" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34515 } } peers { permanent_uuid: "2dccbbe9b76e45afac26659603b7d0df" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 33443 } attrs { promote: false } } peers { permanent_uuid: "65c1309dcd1642de96ea37b06142fcbb" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 39133 } attrs { promote: false } } }
I20260810 06:40:51.260892 5408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dccbbe9b76e45afac26659603b7d0df [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:40:51.260975 5422 mvcc.cc:205] Tried to move back new op lower bound from 7316865233955016704 to 7316865233915199488. Current Snapshot: MvccSnapshot[applied={T|T < 7316865233955016704 or (T in {7316865233955016704})}]
I20260810 06:40:51.266273 5402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.262809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:34003 (local address 127.0.0.1:41600)
0810 06:40:51.263042 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.263053 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:51.263111 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:51.263279 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:51.263280 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:51.263282 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:51.263317 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:51.263318 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.264207 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.264208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:51.265196 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:51.265199 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.266008 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.266010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:51.266071 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:51.266075 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:51.266133 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 06:40:51.266171 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":29,"thread_start_us":73,"threads_started":1}
I20260810 06:40:51.266355 5403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.262740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:39589 (local address 127.0.0.1:60102)
0810 06:40:51.262794 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.262805 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:51.262848 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:51.263202 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:51.263202 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:51.263203 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:51.263255 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:51.263256 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.263983 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.263984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:51.264771 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:51.264773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.266125 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.266126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:51.266199 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:51.266204 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:40:51.266256 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 06:40:51.266294 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 06:40:51.266517 5430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.262896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41600 (local address 127.27.41.131:34003)
0810 06:40:51.263053 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:51.263055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:51.263100 (+ 45us) server_negotiation.cc:407] Connection header received
0810 06:40:51.263166 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:51.263167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:51.263177 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:51.263271 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:51.263375 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.264114 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.265297 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.265927 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.265998 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:51.266012 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:51.266395 (+ 383us) server_negotiation.cc:299] Negotiation successful
0810 06:40:51.266447 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":81,"threads_started":1}
I20260810 06:40:51.266753 5207 tablet_service.cc:1467] Processing CreateTablet for tablet 518f6db2b1524da7bdf670787007e931 (DEFAULT_TABLE table=test-table [id=56519f8a4c1548eb904296c509f1ad8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:51.266928 5207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518f6db2b1524da7bdf670787007e931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:51.267138 5431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.262933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60102 (local address 127.27.41.130:39589)
0810 06:40:51.263053 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:51.263055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:51.263064 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:51.263094 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:51.263095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:51.263108 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:51.263200 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:51.263332 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.263859 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.264877 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.265997 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.266130 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:51.266145 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:51.266902 (+ 757us) server_negotiation.cc:299] Negotiation successful
0810 06:40:51.267060 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":71,"threads_started":1}
I20260810 06:40:51.267279 5429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.262746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:38031 (local address 127.0.0.1:49982)
0810 06:40:51.262962 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.262971 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:51.263026 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:51.263302 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:51.263303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:51.263305 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:51.263669 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:51.263673 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.264595 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.264596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:51.266185 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:51.266187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.267013 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.267014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:51.267093 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:51.267099 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:40:51.267181 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 06:40:51.267221 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":62}
I20260810 06:40:51.267354 5428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.262832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49982 (local address 127.27.41.129:38031)
0810 06:40:51.263127 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:51.263129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:51.263137 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:40:51.263164 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:51.263165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:51.263175 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:51.263252 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:51.263767 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.264506 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.266267 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.266933 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.267006 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:51.267019 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:51.267224 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 06:40:51.267294 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":65,"threads_started":1}
I20260810 06:40:51.267575 4830 tablet_service.cc:1467] Processing CreateTablet for tablet 518f6db2b1524da7bdf670787007e931 (DEFAULT_TABLE table=test-table [id=56519f8a4c1548eb904296c509f1ad8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:51.267716 4830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518f6db2b1524da7bdf670787007e931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:51.268538 5432 tablet_bootstrap.cc:492] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9: Bootstrap starting.
I20260810 06:40:51.268935 5432 tablet_bootstrap.cc:654] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:51.269269 5433 tablet_bootstrap.cc:492] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d: Bootstrap starting.
I20260810 06:40:51.269438 5017 tablet_service.cc:1467] Processing CreateTablet for tablet 518f6db2b1524da7bdf670787007e931 (DEFAULT_TABLE table=test-table [id=56519f8a4c1548eb904296c509f1ad8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:51.269568 5017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 518f6db2b1524da7bdf670787007e931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:51.269680 5433 tablet_bootstrap.cc:654] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:51.270318 5433 tablet_bootstrap.cc:492] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d: No bootstrap required, opened a new log
I20260810 06:40:51.270318 5432 tablet_bootstrap.cc:492] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9: No bootstrap required, opened a new log
I20260810 06:40:51.270375 5433 ts_tablet_manager.cc:1397] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:51.270375 5432 ts_tablet_manager.cc:1397] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:40:51.270521 5432 raft_consensus.cc:348] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } } peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } }
I20260810 06:40:51.270603 5432 raft_consensus.cc:374] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:51.270623 5432 raft_consensus.cc:729] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46738ea298e7416988668e22f026acd9, State: Initialized, Role: FOLLOWER
I20260810 06:40:51.270521 5433 raft_consensus.cc:348] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } } peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } }
I20260810 06:40:51.270732 5432 consensus_queue.cc:260] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } } peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } }
I20260810 06:40:51.270895 5432 ts_tablet_manager.cc:1428] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:51.270684 5433 raft_consensus.cc:374] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:51.271070 5433 raft_consensus.cc:729] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff18abd93df34acca7f1a0ba884fea1d, State: Initialized, Role: FOLLOWER
I20260810 06:40:51.271709 5439 tablet_bootstrap.cc:492] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e: Bootstrap starting.
I20260810 06:40:51.271220 5433 consensus_queue.cc:260] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } } peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } }
I20260810 06:40:51.272011 5433 ts_tablet_manager.cc:1428] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:40:51.272115 5439 tablet_bootstrap.cc:654] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:51.272382 5441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.272151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.129:54969)
0810 06:40:51.272292 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.272332 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":100,"threads_started":1}
I20260810 06:40:51.272502 5438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.271127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.131:43595)
0810 06:40:51.272427 (+ 1300us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.272467 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1276,"thread_start_us":85,"threads_started":1}
I20260810 06:40:51.272614 5309 heartbeater.cc:503] Master 127.27.41.188:39133 was elected leader, sending a full tablet report...
I20260810 06:40:51.272707 4926 heartbeater.cc:503] Master 127.27.41.188:39133 was elected leader, sending a full tablet report...
I20260810 06:40:51.273023 5438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.272862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.131:41051)
0810 06:40:51.272968 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.272997 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260810 06:40:51.273190 5441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.272990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.129:35379)
0810 06:40:51.273043 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.273162 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 06:40:51.273871 5439 tablet_bootstrap.cc:492] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e: No bootstrap required, opened a new log
I20260810 06:40:51.273917 5439 ts_tablet_manager.cc:1397] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:40:51.274040 5439 raft_consensus.cc:348] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } } peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } }
I20260810 06:40:51.274125 5439 raft_consensus.cc:374] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:51.274148 5439 raft_consensus.cc:729] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f90f5fd6adac41ffb8a8dfc12564d74e, State: Initialized, Role: FOLLOWER
I20260810 06:40:51.274211 5439 consensus_queue.cc:260] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } } peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } }
I20260810 06:40:51.274389 5439 ts_tablet_manager.cc:1428] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:51.274749 5116 heartbeater.cc:503] Master 127.27.41.188:39133 was elected leader, sending a full tablet report...
I20260810 06:40:51.274819 5447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.274588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.130:53119)
0810 06:40:51.274709 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.274747 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":76,"threads_started":1}
I20260810 06:40:51.275328 5447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.275225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.130:53771)
0810 06:40:51.275275 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.275305 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 06:40:51.338152 5313 tablet.cc:2369] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:40:51.348752 5437 raft_consensus.cc:482] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:51.348829 5437 raft_consensus.cc:504] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } } peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } }
I20260810 06:40:51.349036 5437 leader_election.cc:288] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f90f5fd6adac41ffb8a8dfc12564d74e (127.27.41.130:39589), ff18abd93df34acca7f1a0ba884fea1d (127.27.41.129:38031)
I20260810 06:40:51.349268 5044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518f6db2b1524da7bdf670787007e931" candidate_uuid: "46738ea298e7416988668e22f026acd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" is_pre_election: true
I20260810 06:40:51.349274 4859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518f6db2b1524da7bdf670787007e931" candidate_uuid: "46738ea298e7416988668e22f026acd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff18abd93df34acca7f1a0ba884fea1d" is_pre_election: true
I20260810 06:40:51.349396 5044 raft_consensus.cc:2454] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46738ea298e7416988668e22f026acd9 in term 0.
I20260810 06:40:51.349494 4859 raft_consensus.cc:2454] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46738ea298e7416988668e22f026acd9 in term 0.
I20260810 06:40:51.349610 5145 leader_election.cc:302] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46738ea298e7416988668e22f026acd9, f90f5fd6adac41ffb8a8dfc12564d74e; no voters:
I20260810 06:40:51.349728 5437 raft_consensus.cc:2781] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:51.349772 5437 raft_consensus.cc:482] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:51.349786 5437 raft_consensus.cc:3037] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:51.350610 5437 raft_consensus.cc:504] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } } peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } }
I20260810 06:40:51.350804 5437 leader_election.cc:288] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [CANDIDATE]: Term 1 election: Requested vote from peers f90f5fd6adac41ffb8a8dfc12564d74e (127.27.41.130:39589), ff18abd93df34acca7f1a0ba884fea1d (127.27.41.129:38031)
I20260810 06:40:51.350924 5044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518f6db2b1524da7bdf670787007e931" candidate_uuid: "46738ea298e7416988668e22f026acd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e"
I20260810 06:40:51.351032 5044 raft_consensus.cc:3037] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:51.350997 4859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "518f6db2b1524da7bdf670787007e931" candidate_uuid: "46738ea298e7416988668e22f026acd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff18abd93df34acca7f1a0ba884fea1d"
I20260810 06:40:51.351068 4859 raft_consensus.cc:3037] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:51.351864 4859 raft_consensus.cc:2454] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46738ea298e7416988668e22f026acd9 in term 1.
I20260810 06:40:51.351908 5044 raft_consensus.cc:2454] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46738ea298e7416988668e22f026acd9 in term 1.
I20260810 06:40:51.352056 5143 leader_election.cc:302] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46738ea298e7416988668e22f026acd9, ff18abd93df34acca7f1a0ba884fea1d; no voters:
I20260810 06:40:51.352174 5437 raft_consensus.cc:2781] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:51.352396 5437 raft_consensus.cc:686] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [term 1 LEADER]: Becoming Leader. State: Replica: 46738ea298e7416988668e22f026acd9, State: Running, Role: LEADER
I20260810 06:40:51.352473 5437 consensus_queue.cc:237] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } } peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } }
I20260810 06:40:51.352872 5438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.352746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.131:49297)
0810 06:40:51.352786 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.352833 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260810 06:40:51.353242 4675 catalog_manager.cc:5495] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46738ea298e7416988668e22f026acd9 (127.27.41.131). New cstate: current_term: 1 leader_uuid: "46738ea298e7416988668e22f026acd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46738ea298e7416988668e22f026acd9" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34003 } health_report { overall_health: HEALTHY } } }
I20260810 06:40:51.381714 5430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.379470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41602 (local address 127.27.41.131:34003)
0810 06:40:51.379541 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:51.379543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:51.379553 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:40:51.379620 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:51.379621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:51.379630 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:51.379680 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:51.379819 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.380295 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.381032 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:51.381255 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:51.381308 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:51.381465 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:51.381493 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:51.381532 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:51.381590 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 06:40:51.381608 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:40:51.382700 5044 raft_consensus.cc:1261] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e [term 1 FOLLOWER]: Refusing update from remote peer 46738ea298e7416988668e22f026acd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:51.382726 4859 raft_consensus.cc:1261] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d [term 1 FOLLOWER]: Refusing update from remote peer 46738ea298e7416988668e22f026acd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:51.383018 5437 consensus_queue.cc:1035] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff18abd93df34acca7f1a0ba884fea1d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:51.383191 5448 consensus_queue.cc:1035] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f90f5fd6adac41ffb8a8dfc12564d74e" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:51.383875 5441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.383619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.129:59723)
0810 06:40:51.383809 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.383842 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171}
I20260810 06:40:51.384006 5447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.383743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.130:43023)
0810 06:40:51.383869 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.383895 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260810 06:40:51.385439 5438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.385085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.131:52299)
0810 06:40:51.385371 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.385407 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270}
I20260810 06:40:51.385748 5441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.385606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.129:55223)
0810 06:40:51.385685 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.385717 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260810 06:40:51.386380 5447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.386248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34515 (local address 127.27.41.130:52321)
0810 06:40:51.386307 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.386347 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:34515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 06:40:51.387036 4674 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:51.387120 4674 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:51.388523 4674 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 65c1309dcd1642de96ea37b06142fcbb: Sending DeleteTablet for 3 replicas of tablet 518f6db2b1524da7bdf670787007e931
I20260810 06:40:51.388805 5017 tablet_service.cc:1514] Processing DeleteTablet for tablet 518f6db2b1524da7bdf670787007e931 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:51 UTC) from {username='oryx', principal='oryx/127.27.41.188@KRBTEST.COM'} at 127.0.0.1:60102
I20260810 06:40:51.388844 4830 tablet_service.cc:1514] Processing DeleteTablet for tablet 518f6db2b1524da7bdf670787007e931 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:51 UTC) from {username='oryx', principal='oryx/127.27.41.188@KRBTEST.COM'} at 127.0.0.1:49982
I20260810 06:40:51.388981 5207 tablet_service.cc:1514] Processing DeleteTablet for tablet 518f6db2b1524da7bdf670787007e931 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:51 UTC) from {username='oryx', principal='oryx/127.27.41.188@KRBTEST.COM'} at 127.0.0.1:41600
I20260810 06:40:51.389038 5464 tablet_replica.cc:330] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d: stopping tablet replica
I20260810 06:40:51.389106 5464 raft_consensus.cc:2229] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:51.389106 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 4752
I20260810 06:40:51.389154 5463 tablet_replica.cc:330] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e: stopping tablet replica
I20260810 06:40:51.389163 5464 raft_consensus.cc:2258] T 518f6db2b1524da7bdf670787007e931 P ff18abd93df34acca7f1a0ba884fea1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:51.389212 5463 raft_consensus.cc:2229] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:51.389266 5463 raft_consensus.cc:2258] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:51.389369 5466 tablet_replica.cc:330] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9: stopping tablet replica
I20260810 06:40:51.389460 5466 raft_consensus.cc:2229] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:40:51.389564 5466 raft_consensus.cc:2258] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:51.389626 5463 ts_tablet_manager.cc:1905] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:51.391474 5463 ts_tablet_manager.cc:1918] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:51.391539 5463 log.cc:1196] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/518f6db2b1524da7bdf670787007e931
I20260810 06:40:51.391733 5466 ts_tablet_manager.cc:1905] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:51.391776 5463 ts_tablet_manager.cc:1939] T 518f6db2b1524da7bdf670787007e931 P f90f5fd6adac41ffb8a8dfc12564d74e: Deleting consensus metadata
I20260810 06:40:51.392969 4656 catalog_manager.cc:4841] TS f90f5fd6adac41ffb8a8dfc12564d74e (127.27.41.130:39589): tablet 518f6db2b1524da7bdf670787007e931 (table test-table [id=56519f8a4c1548eb904296c509f1ad8e]) successfully deleted
I20260810 06:40:51.396147 5466 ts_tablet_manager.cc:1918] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:51.396279 5466 log.cc:1196] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/518f6db2b1524da7bdf670787007e931
I20260810 06:40:51.396637 5466 ts_tablet_manager.cc:1939] T 518f6db2b1524da7bdf670787007e931 P 46738ea298e7416988668e22f026acd9: Deleting consensus metadata
I20260810 06:40:51.397101 4654 catalog_manager.cc:4841] TS 46738ea298e7416988668e22f026acd9 (127.27.41.131:34003): tablet 518f6db2b1524da7bdf670787007e931 (table test-table [id=56519f8a4c1548eb904296c509f1ad8e]) successfully deleted
I20260810 06:40:51.404101 5429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:51.403966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:38031 (local address 127.0.0.1:49988)
0810 06:40:51.404030 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:51.404065 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:38031: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 06:40:51.404186 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 4939
W20260810 06:40:51.404294 4655 catalog_manager.cc:4584] TS ff18abd93df34acca7f1a0ba884fea1d (127.27.41.129:38031): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 518f6db2b1524da7bdf670787007e931: Network error: Client connection negotiation failed: client connection to 127.27.41.129:38031: connect: Connection refused (error 111)
I20260810 06:40:51.413537 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 5123
I20260810 06:40:51.425240 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 4220
I20260810 06:40:51.434727 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 4483
2026-08-10T06:40:51Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (4914 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:51 dist-test-slave-bw88 krb5kdc[5470](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:51 dist-test-slave-bw88 krb5kdc[5470](info): set up 2 sockets
Aug 10 06:40:51 dist-test-slave-bw88 krb5kdc[5470](info): commencing operation
krb5kdc: starting...
W20260810 06:40:52.635640 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:52 dist-test-slave-bw88 krb5kdc[5470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:52Z Disabled control of system clock
WARNING: no policy specified for oryx/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.190.keytab.
Entry for principal oryx/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.190.keytab.
I20260810 06:40:52.759816 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38269
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.190.keytab
--principal=oryx/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:45875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:38269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:52.843127 5489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:52.843322 5489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:52.843343 5489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:52.844383 5489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:52.844416 5489 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 06:40:52.844429 5489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:52.844453 5489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:52.844465 5489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:52.844480 5489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:52.846104 5489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:45875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:38269
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.190.keytab
--principal=oryx/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:52.846311 5489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:52.846493 5489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:52.851462 5499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:52.851540 5496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:52.851473 5494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:52.851715 5489 server_base.cc:1034] running on GCE node
I20260810 06:40:52.852002 5489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:52.852247 5489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:52.853404 5489 hybrid_clock.cc:648] HybridClock initialized: now 1786344052853382 us; error 40 us; skew 500 ppm
Aug 10 06:40:52 dist-test-slave-bw88 krb5kdc[5470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344052, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:52.855854 5489 init.cc:377] Logged in from keytab as oryx/127.27.41.190@KRBTEST.COM (short username oryx)
I20260810 06:40:52.856302 5489 webserver.cc:460] Webserver started at http://127.27.41.190:38129/ using document root <none> and password file <none>
I20260810 06:40:52.856537 5489 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:52.856608 5489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:52.856763 5489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:52.858013 5489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "fbc58088d7494a89b04b584ab8200e9a"
format_stamp: "Formatted at 2026-08-10 06:40:52 on dist-test-slave-bw88"
server_key: "82550cff78c24c3068c9773a8a12d0f3"
server_key_iv: "38f7625aadb77a6a65ac75e080057dc0"
server_key_version: "encryptionkey@0"
I20260810 06:40:52.858399 5489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "fbc58088d7494a89b04b584ab8200e9a"
format_stamp: "Formatted at 2026-08-10 06:40:52 on dist-test-slave-bw88"
server_key: "82550cff78c24c3068c9773a8a12d0f3"
server_key_iv: "38f7625aadb77a6a65ac75e080057dc0"
server_key_version: "encryptionkey@0"
I20260810 06:40:52.859791 5489 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:40:52.860495 5508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:52.860675 5489 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:52.860796 5489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "fbc58088d7494a89b04b584ab8200e9a"
format_stamp: "Formatted at 2026-08-10 06:40:52 on dist-test-slave-bw88"
server_key: "82550cff78c24c3068c9773a8a12d0f3"
server_key_iv: "38f7625aadb77a6a65ac75e080057dc0"
server_key_version: "encryptionkey@0"
I20260810 06:40:52.860882 5489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:52.877833 5489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:52.879716 5489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:52.879890 5489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:52.884992 5489 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:38269
I20260810 06:40:52.885048 5599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:38269 every 8 connection(s)
I20260810 06:40:52.885494 5489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:52.886255 5600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:52.888605 5600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a: Bootstrap starting.
I20260810 06:40:52.889276 5600 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:52.889613 5600 log.cc:824] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:52.890341 5600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a: No bootstrap required, opened a new log
I20260810 06:40:52.892416 5600 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc58088d7494a89b04b584ab8200e9a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38269 } }
I20260810 06:40:52.892577 5600 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:52.892601 5600 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc58088d7494a89b04b584ab8200e9a, State: Initialized, Role: FOLLOWER
I20260810 06:40:52.892735 5600 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc58088d7494a89b04b584ab8200e9a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38269 } }
I20260810 06:40:52.892820 5600 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:52.892843 5600 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:52.892872 5600 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:52.893380 5600 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc58088d7494a89b04b584ab8200e9a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38269 } }
I20260810 06:40:52.893465 5600 leader_election.cc:302] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbc58088d7494a89b04b584ab8200e9a; no voters:
I20260810 06:40:52.893594 5600 leader_election.cc:288] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:52.893695 5603 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:52.893865 5603 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [term 1 LEADER]: Becoming Leader. State: Replica: fbc58088d7494a89b04b584ab8200e9a, State: Running, Role: LEADER
I20260810 06:40:52.893929 5600 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:52.893960 5603 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc58088d7494a89b04b584ab8200e9a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38269 } }
I20260810 06:40:52.894330 5605 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbc58088d7494a89b04b584ab8200e9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc58088d7494a89b04b584ab8200e9a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38269 } } }
I20260810 06:40:52.894434 5605 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:52.894343 5607 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbc58088d7494a89b04b584ab8200e9a. Latest consensus state: current_term: 1 leader_uuid: "fbc58088d7494a89b04b584ab8200e9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc58088d7494a89b04b584ab8200e9a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38269 } } }
I20260810 06:40:52.894552 5607 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:52.894655 5613 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:52.895279 5613 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:52.895656 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 5489
I20260810 06:40:52.895789 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:52.896009 27814 external_mini_cluster.cc:1428] Setting key a87f26d552e8661a42e35d10a038fad9
I20260810 06:40:52.897007 5613 catalog_manager.cc:1347] Generated new cluster ID: 3e6f42956cdd420893d0b7d981aba08b
I20260810 06:40:52.897066 5613 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:40:52 dist-test-slave-bw88 krb5kdc[5470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
I20260810 06:40:52.906189 5633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:52.896471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58246 (local address 127.27.41.190:38269)
0810 06:40:52.897049 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:52.897074 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:52.897107 (+ 33us) server_negotiation.cc:407] Connection header received
0810 06:40:52.897228 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:52.897233 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:52.897273 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:52.897457 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:52.898118 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:52.899036 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:52.899786 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:52.900225 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:52.900349 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:52.902823 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:52.902827 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:52.902827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:52.902839 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:52.904502 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:52.904921 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:52.904924 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:52.904924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:52.905014 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:52.905226 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:52.905227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:52.905228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:52.905544 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:52.905753 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:52.905824 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 06:40:52.905964 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":80,"threads_started":1}
I20260810 06:40:52.906953 5613 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:52.907418 5613 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:52.909271 5613 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a: Generated new TSK 0
I20260810 06:40:52.909446 5613 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab.
Entry for principal oryx/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab.
I20260810 06:40:52.940800 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38269
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab
--principal=oryx/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:45875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:53.024663 5637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:53.024916 5637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:53.024957 5637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:53.026196 5637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:53.026262 5637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:53.026295 5637 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:40:53.026336 5637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:53.027818 5637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:45875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab
--principal=oryx/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.41.190:38269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:53.028080 5637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:53.028308 5637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:53.033654 5644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:53.033697 5648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:53.033841 5637 server_base.cc:1034] running on GCE node
W20260810 06:40:53.033871 5643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:53.034112 5637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:53.034369 5637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:53.035547 5637 hybrid_clock.cc:648] HybridClock initialized: now 1786344053035539 us; error 29 us; skew 500 ppm
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344053, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:53.038278 5637 init.cc:377] Logged in from keytab as oryx/127.27.41.129@KRBTEST.COM (short username oryx)
I20260810 06:40:53.038820 5637 webserver.cc:460] Webserver started at http://127.27.41.129:44483/ using document root <none> and password file <none>
I20260810 06:40:53.039062 5637 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:53.039136 5637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:53.039281 5637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:53.040412 5637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "b6164767a5f34522a3dddbf1440d9a46"
format_stamp: "Formatted at 2026-08-10 06:40:53 on dist-test-slave-bw88"
server_key: "c03fe00423ae1e7daed6fcf4ff474439"
server_key_iv: "9d7b883f415a8d8d42c66cfa0869aa1f"
server_key_version: "encryptionkey@0"
I20260810 06:40:53.040802 5637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "b6164767a5f34522a3dddbf1440d9a46"
format_stamp: "Formatted at 2026-08-10 06:40:53 on dist-test-slave-bw88"
server_key: "c03fe00423ae1e7daed6fcf4ff474439"
server_key_iv: "9d7b883f415a8d8d42c66cfa0869aa1f"
server_key_version: "encryptionkey@0"
I20260810 06:40:53.042280 5637 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:40:53.043028 5657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:53.043203 5637 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:53.043313 5637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "b6164767a5f34522a3dddbf1440d9a46"
format_stamp: "Formatted at 2026-08-10 06:40:53 on dist-test-slave-bw88"
server_key: "c03fe00423ae1e7daed6fcf4ff474439"
server_key_iv: "9d7b883f415a8d8d42c66cfa0869aa1f"
server_key_version: "encryptionkey@0"
I20260810 06:40:53.043390 5637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:53.081034 5637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:53.083360 5637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:53.083562 5637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:53.084165 5637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:53.084233 5637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:53.084270 5637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:53.084314 5637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344053, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
I20260810 06:40:53.093075 5637 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:44331
I20260810 06:40:53.093189 5819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:44331 every 8 connection(s)
I20260810 06:40:53.093605 5637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:40:53.096665 5633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.084740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:47737 (local address 127.27.41.190:38269)
0810 06:40:53.084811 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.084814 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.085150 (+ 336us) server_negotiation.cc:407] Connection header received
0810 06:40:53.086019 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.086020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.086065 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.086164 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:53.087260 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.088429 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.090156 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.090467 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.090578 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.093770 (+ 3192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:53.093771 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:53.093772 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:53.093780 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:53.095269 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.095837 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.095838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.095839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.095895 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.096112 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.096112 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.096112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.096215 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:53.096264 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.096515 (+ 251us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.096593 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 06:40:53.096743 5667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.084688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38269 (local address 127.27.41.129:47737)
0810 06:40:53.084968 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.085024 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.085835 (+ 811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.086288 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.086294 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.086756 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:53.087115 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.087124 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.088560 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.088562 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.090001 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.090005 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.090761 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.090762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.090965 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.091531 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:53.091544 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:53.093641 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:53.095344 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.095351 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.095353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.095704 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.095954 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.095955 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.095955 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.096068 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.096268 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:53.096272 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:53.096389 (+ 117us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.096463 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.096591 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":92,"threads_started":1}
I20260810 06:40:53.097273 5821 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38269
I20260810 06:40:53.097399 5821 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:53.097609 5821 heartbeater.cc:511] Master 127.27.41.190:38269 requested a full tablet report, sending...
I20260810 06:40:53.097684 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 5637
I20260810 06:40:53.097817 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:40:53.098073 27814 external_mini_cluster.cc:1428] Setting key ea15ca2e0984345784fcd6ded56d6e13
I20260810 06:40:53.098631 5533 ts_manager.cc:194] Registered new tserver with Master: b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129:44331)
I20260810 06:40:53.099416 5533 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:47737
I20260810 06:40:53.104347 5633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.098428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:59591 (local address 127.27.41.190:38269)
0810 06:40:53.098461 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.098464 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.098620 (+ 156us) server_negotiation.cc:407] Connection header received
0810 06:40:53.098713 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.098714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.098724 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.098751 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:53.099135 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.099831 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.100726 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.100928 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.101022 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.101931 (+ 909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:53.101933 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:53.101933 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:53.101948 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:53.103208 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.103565 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.103566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.103566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.103637 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.103834 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.103835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.103835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.103948 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:53.104019 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.104184 (+ 165us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.104263 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 06:40:53.104357 5829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.098383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38269 (local address 127.27.41.129:59591)
0810 06:40:53.098560 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.098571 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.098643 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.098809 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.098810 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.099006 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:53.099062 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.099064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.099961 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.099963 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.100624 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.100627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.101024 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.101025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.101096 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.101558 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:53.101562 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:53.101830 (+ 268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:53.103297 (+ 1467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.103298 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.103298 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.103480 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.103702 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.103702 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.103703 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.103763 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.104030 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:53.104032 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:53.104076 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.104159 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.104263 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":46,"thread_start_us":117,"threads_started":1}
WARNING: no policy specified for oryx/127.27.41.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab.
Entry for principal oryx/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab.
I20260810 06:40:53.125670 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38269
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab
--principal=oryx/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:45875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:53.207950 5832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:53.208199 5832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:53.208237 5832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:53.209496 5832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:53.209568 5832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:53.209601 5832 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:40:53.209643 5832 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:53.211169 5832 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:45875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab
--principal=oryx/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.41.190:38269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:53.211436 5832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:53.211679 5832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:53.216933 5842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:53.216958 5846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:53.217095 5832 server_base.cc:1034] running on GCE node
W20260810 06:40:53.216933 5839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:53.217521 5832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:53.217782 5832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:53.218919 5832 hybrid_clock.cc:648] HybridClock initialized: now 1786344053218911 us; error 28 us; skew 500 ppm
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344053, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:53.221572 5832 init.cc:377] Logged in from keytab as oryx/127.27.41.130@KRBTEST.COM (short username oryx)
I20260810 06:40:53.222021 5832 webserver.cc:460] Webserver started at http://127.27.41.130:34447/ using document root <none> and password file <none>
I20260810 06:40:53.222247 5832 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:53.222292 5832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:53.222443 5832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:53.223503 5832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "c54e5889625e407694e3ac3b6c4d8612"
format_stamp: "Formatted at 2026-08-10 06:40:53 on dist-test-slave-bw88"
server_key: "a769b071541dbf3695568ff57314534d"
server_key_iv: "d4b7895fcaae9ee03e56a904635a5863"
server_key_version: "encryptionkey@0"
I20260810 06:40:53.223861 5832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "c54e5889625e407694e3ac3b6c4d8612"
format_stamp: "Formatted at 2026-08-10 06:40:53 on dist-test-slave-bw88"
server_key: "a769b071541dbf3695568ff57314534d"
server_key_iv: "d4b7895fcaae9ee03e56a904635a5863"
server_key_version: "encryptionkey@0"
I20260810 06:40:53.225188 5832 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:40:53.226138 5857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:53.226362 5832 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:53.226441 5832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "c54e5889625e407694e3ac3b6c4d8612"
format_stamp: "Formatted at 2026-08-10 06:40:53 on dist-test-slave-bw88"
server_key: "a769b071541dbf3695568ff57314534d"
server_key_iv: "d4b7895fcaae9ee03e56a904635a5863"
server_key_version: "encryptionkey@0"
I20260810 06:40:53.226526 5832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:53.237035 5832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:53.238988 5832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:53.239094 5832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:53.239670 5832 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:53.239710 5832 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:53.239732 5832 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:53.239779 5832 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344053, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
I20260810 06:40:53.247637 5832 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:32789
I20260810 06:40:53.247776 6012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:32789 every 8 connection(s)
I20260810 06:40:53.248096 5832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:40:53.250074 5633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.240051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:45181 (local address 127.27.41.190:38269)
0810 06:40:53.240094 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.240096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.240360 (+ 264us) server_negotiation.cc:407] Connection header received
0810 06:40:53.240886 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.240887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.240901 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.240979 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:53.241719 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.242267 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.243336 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.243604 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.243690 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.247335 (+ 3645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:53.247337 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:53.247338 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:53.247346 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:53.248910 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.249261 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.249262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.249262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.249312 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.249584 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.249584 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.249584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.249682 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:53.249731 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.249933 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.250010 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:40:53.250300 5868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.240048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38269 (local address 127.27.41.130:45181)
0810 06:40:53.240183 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.240243 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.240778 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.241035 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.241039 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.241300 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:53.241630 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.241638 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.242370 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.242371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.243217 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.243220 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.243701 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.243702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.243844 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.244373 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:53.244383 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:53.247229 (+ 2846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:53.248980 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.248984 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.248986 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.249193 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.249432 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.249433 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.249433 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.249533 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.249736 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:53.249740 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:53.249842 (+ 102us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.249914 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.250057 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":78,"threads_started":1}
I20260810 06:40:53.250545 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 5832
I20260810 06:40:53.250701 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:40:53.250910 27814 external_mini_cluster.cc:1428] Setting key 8d439a5b7e37951cbf7ca5df593e7967
I20260810 06:40:53.250897 6013 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38269
I20260810 06:40:53.250980 6013 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:53.251242 6013 heartbeater.cc:511] Master 127.27.41.190:38269 requested a full tablet report, sending...
I20260810 06:40:53.251659 5530 ts_manager.cc:194] Registered new tserver with Master: c54e5889625e407694e3ac3b6c4d8612 (127.27.41.130:32789)
I20260810 06:40:53.252036 5530 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:45181
I20260810 06:40:53.259356 6022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.253539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38269 (local address 127.27.41.130:40167)
0810 06:40:53.253678 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.253691 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.253756 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.253875 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.253876 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.254104 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:53.254175 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.254177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.254842 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.254842 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.255331 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.255333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.255814 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.255814 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.255861 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.256294 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:53.256299 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:53.256622 (+ 323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:53.258379 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.258380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.258381 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.258548 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.258752 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.258753 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.258753 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.258802 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.259140 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:53.259140 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:53.259175 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.259225 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.259296 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":77,"threads_started":1}
I20260810 06:40:53.259456 5633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.253597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:40167 (local address 127.27.41.190:38269)
0810 06:40:53.253638 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.253640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.253739 (+ 99us) server_negotiation.cc:407] Connection header received
0810 06:40:53.253813 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.253813 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.253821 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.253861 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:53.254245 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.254746 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.255412 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.255728 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.255816 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.256713 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:53.256715 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:53.256715 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:53.256721 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:53.258301 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.258621 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.258622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.258622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.258686 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.258858 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.258859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.258860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.259057 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:53.259129 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.259280 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.259365 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
WARNING: no policy specified for oryx/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab.
Entry for principal oryx/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab.
I20260810 06:40:53.280193 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38269
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab
--principal=oryx/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:45875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:53.362905 6024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:53.363150 6024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:53.363174 6024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:53.364404 6024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:53.364466 6024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:53.364503 6024 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:40:53.364559 6024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:53.366101 6024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:45875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab
--principal=oryx/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.41.190:38269
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:53.366366 6024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:53.366626 6024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:53.371681 6036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:53.371691 6032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:53.371701 6029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:53.371865 6024 server_base.cc:1034] running on GCE node
I20260810 06:40:53.372071 6024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:53.372363 6024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:53.373525 6024 hybrid_clock.cc:648] HybridClock initialized: now 1786344053373511 us; error 42 us; skew 500 ppm
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344053, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:53.376186 6024 init.cc:377] Logged in from keytab as oryx/127.27.41.131@KRBTEST.COM (short username oryx)
I20260810 06:40:53.376641 6024 webserver.cc:460] Webserver started at http://127.27.41.131:36275/ using document root <none> and password file <none>
I20260810 06:40:53.376881 6024 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:53.376959 6024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:53.377110 6024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:53.378255 6024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "363a51d7b4494d40870356b269747c07"
format_stamp: "Formatted at 2026-08-10 06:40:53 on dist-test-slave-bw88"
server_key: "71def4b1bed3bfc494debd7f51d7a1e5"
server_key_iv: "8c8214418acf01397e55e0ee6fc21f20"
server_key_version: "encryptionkey@0"
I20260810 06:40:53.378623 6024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "363a51d7b4494d40870356b269747c07"
format_stamp: "Formatted at 2026-08-10 06:40:53 on dist-test-slave-bw88"
server_key: "71def4b1bed3bfc494debd7f51d7a1e5"
server_key_iv: "8c8214418acf01397e55e0ee6fc21f20"
server_key_version: "encryptionkey@0"
I20260810 06:40:53.379959 6024 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 06:40:53.380671 6043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:53.380867 6024 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:40:53.380973 6024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "363a51d7b4494d40870356b269747c07"
format_stamp: "Formatted at 2026-08-10 06:40:53 on dist-test-slave-bw88"
server_key: "71def4b1bed3bfc494debd7f51d7a1e5"
server_key_iv: "8c8214418acf01397e55e0ee6fc21f20"
server_key_version: "encryptionkey@0"
I20260810 06:40:53.381058 6024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:53.393637 6024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:53.396210 6024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:53.396385 6024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:53.397022 6024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:53.397085 6024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:53.397130 6024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:53.397159 6024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344053, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
I20260810 06:40:53.404317 6024 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:40551
I20260810 06:40:53.404753 6024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:40:53.404877 6195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:40551 every 8 connection(s)
I20260810 06:40:53.405061 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 6024
I20260810 06:40:53.405153 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:40:53.405385 27814 external_mini_cluster.cc:1428] Setting key 5bf4de9b94f995eebef497557bfd8bcf
I20260810 06:40:53.408157 5633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.397412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:41461 (local address 127.27.41.190:38269)
0810 06:40:53.397465 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.397468 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.397770 (+ 302us) server_negotiation.cc:407] Connection header received
0810 06:40:53.398315 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.398317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.398331 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.398431 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:53.399166 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.400061 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.401662 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.402066 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.402158 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.404782 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:53.404784 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:53.404784 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:53.404792 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:53.406772 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.407169 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.407170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.407171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.407253 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.407510 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.407511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.407511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.407629 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:53.407704 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.407986 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.408071 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 06:40:53.408325 6059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.397454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38269 (local address 127.27.41.131:41461)
0810 06:40:53.397615 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.397654 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.398215 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.398494 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.398497 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.398788 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:53.399059 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.399066 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.400168 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.400170 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.401559 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.401563 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.402192 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.402193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.402343 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.402929 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:53.402938 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:53.404669 (+ 1731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:53.406841 (+ 2172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.406848 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.406850 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.407093 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.407319 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.407320 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.407320 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.407435 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.407695 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:53.407702 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:53.407837 (+ 135us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.407958 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.408108 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260810 06:40:53.408783 6198 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38269
I20260810 06:40:53.408869 6198 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:53.409036 6198 heartbeater.cc:511] Master 127.27.41.190:38269 requested a full tablet report, sending...
I20260810 06:40:53.409581 5533 ts_manager.cc:194] Registered new tserver with Master: 363a51d7b4494d40870356b269747c07 (127.27.41.131:40551)
I20260810 06:40:53.410144 5533 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:41461
I20260810 06:40:53.415930 5633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.409927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:40779 (local address 127.27.41.190:38269)
0810 06:40:53.409958 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.409960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.410058 (+ 98us) server_negotiation.cc:407] Connection header received
0810 06:40:53.410120 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.410120 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.410127 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.410172 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:53.410547 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.411031 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.411822 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.412050 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.412131 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.413184 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:53.413186 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:53.413186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:53.413193 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:53.414711 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.415108 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.415109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.415110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.415166 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.415390 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.415391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.415392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.415512 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:53.415594 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.415757 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.415836 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260810 06:40:53.415946 6210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.409864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38269 (local address 127.27.41.131:40779)
0810 06:40:53.410002 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.410012 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.410065 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.410179 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.410180 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.410394 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:53.410472 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.410475 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.411140 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.411141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.411727 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.411728 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.412145 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.412146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.412224 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.412721 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:53.412727 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:53.413034 (+ 307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:53.414822 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.414823 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.414824 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.415014 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.415247 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.415248 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.415249 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.415315 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.415586 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:53.415587 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:53.415636 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.415730 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.415838 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":65,"threads_started":1}
I20260810 06:40:53.417806 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344053, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 06:40:53.440666 5633 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:53.435499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58248 (local address 127.27.41.190:38269)
0810 06:40:53.435560 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.435562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.435577 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:40:53.435601 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.435602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.435610 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.435658 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:53.436185 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.436681 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.437454 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.437643 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.437695 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.440567 (+ 2872us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58248: BlockingRecv error: recv got EOF from 127.0.0.1:58248 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344053, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
I20260810 06:40:53.447899 5633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.441444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58252 (local address 127.27.41.190:38269)
0810 06:40:53.441508 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.441510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.441578 (+ 68us) server_negotiation.cc:407] Connection header received
0810 06:40:53.441654 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.441655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.441664 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.441736 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:53.442212 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.442704 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.443375 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.443557 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.443628 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.445745 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:53.445746 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:53.445747 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:53.445752 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:53.447013 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.447317 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.447319 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.447319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.447369 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.447531 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.447532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.447532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.447627 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:53.447704 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.447785 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.447841 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 06:40:53.449501 5533 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58252:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:40:53.451208 5533 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:53.457978 6231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.453662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:40551 (local address 127.0.0.1:38036)
0810 06:40:53.454012 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.454023 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.454074 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.454471 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.454472 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.454474 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:53.454529 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.454531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.455484 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.455492 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.456653 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.456656 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.457639 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.457640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.457718 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.457753 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.457821 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.457889 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":91,"threads_started":1}
I20260810 06:40:53.458165 6232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.453758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43192 (local address 127.27.41.129:44331)
0810 06:40:53.454032 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.454037 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.454049 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:40:53.454196 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.454198 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.454213 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.454311 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:53.454486 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.455633 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.456803 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.457544 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.457600 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.457676 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.457992 (+ 316us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.458033 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":96,"threads_started":1}
I20260810 06:40:53.458258 6235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.453990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56726 (local address 127.27.41.130:32789)
0810 06:40:53.454149 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.454153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.454532 (+ 379us) server_negotiation.cc:407] Connection header received
0810 06:40:53.454581 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.454583 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.454599 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.454674 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:53.454807 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.455839 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.457041 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.457693 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.457790 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.457878 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.457958 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.458000 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
I20260810 06:40:53.458346 6233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.453759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38036 (local address 127.27.41.131:40551)
0810 06:40:53.454244 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.454249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.454260 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:40:53.454306 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.454308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.454323 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.454398 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:53.454609 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.455390 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.456746 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.457536 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.457625 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.457695 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.458197 (+ 502us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.458241 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":80,"threads_started":1}
I20260810 06:40:53.458374 6230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.453645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:44331 (local address 127.0.0.1:43192)
0810 06:40:53.453957 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.454001 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.454072 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.454315 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.454318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.454320 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:53.454386 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.454388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.455735 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.455735 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.456682 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.456685 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.457795 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.457796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.457885 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.457888 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.458250 (+ 362us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.458297 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":29,"thread_start_us":59,"threads_started":1}
I20260810 06:40:53.459059 6234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.453876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:32789 (local address 127.0.0.1:56726)
0810 06:40:53.454402 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.454412 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.454473 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.454690 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.454691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.454693 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:53.454725 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.454726 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.455925 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.455926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.456930 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.456932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.457803 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.457804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.457874 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.457879 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.457944 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.457988 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":70,"threads_started":1}
I20260810 06:40:53.459179 5729 tablet_service.cc:1467] Processing CreateTablet for tablet 38efa4427db942ac9f3c5bb838a34e56 (DEFAULT_TABLE table=test-table [id=e44a94f144b4484989474daf508d188e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:53.459187 6109 tablet_service.cc:1467] Processing CreateTablet for tablet 38efa4427db942ac9f3c5bb838a34e56 (DEFAULT_TABLE table=test-table [id=e44a94f144b4484989474daf508d188e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:53.459549 5729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38efa4427db942ac9f3c5bb838a34e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:53.459571 6109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38efa4427db942ac9f3c5bb838a34e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:53.459717 5926 tablet_service.cc:1467] Processing CreateTablet for tablet 38efa4427db942ac9f3c5bb838a34e56 (DEFAULT_TABLE table=test-table [id=e44a94f144b4484989474daf508d188e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:53.460047 5926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38efa4427db942ac9f3c5bb838a34e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:53.462970 6236 tablet_bootstrap.cc:492] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46: Bootstrap starting.
I20260810 06:40:53.463456 6237 tablet_bootstrap.cc:492] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07: Bootstrap starting.
I20260810 06:40:53.463857 6236 tablet_bootstrap.cc:654] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:53.464207 6237 tablet_bootstrap.cc:654] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:53.464215 6236 log.cc:824] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:53.464360 6238 tablet_bootstrap.cc:492] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612: Bootstrap starting.
I20260810 06:40:53.464584 6237 log.cc:824] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:53.465029 6238 tablet_bootstrap.cc:654] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:53.465296 6236 tablet_bootstrap.cc:492] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46: No bootstrap required, opened a new log
I20260810 06:40:53.465409 6236 ts_tablet_manager.cc:1397] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:40:53.465417 6238 log.cc:824] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:53.465636 6237 tablet_bootstrap.cc:492] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07: No bootstrap required, opened a new log
I20260810 06:40:53.465709 6237 ts_tablet_manager.cc:1397] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:40:53.466620 6238 tablet_bootstrap.cc:492] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612: No bootstrap required, opened a new log
I20260810 06:40:53.466699 6238 ts_tablet_manager.cc:1397] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 06:40:53.467240 6236 raft_consensus.cc:348] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } }
I20260810 06:40:53.467398 6236 raft_consensus.cc:374] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:53.467443 6236 raft_consensus.cc:729] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6164767a5f34522a3dddbf1440d9a46, State: Initialized, Role: FOLLOWER
I20260810 06:40:53.467553 6236 consensus_queue.cc:260] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } }
I20260810 06:40:53.467854 6236 ts_tablet_manager.cc:1428] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:40:53.467878 5821 heartbeater.cc:503] Master 127.27.41.190:38269 was elected leader, sending a full tablet report...
I20260810 06:40:53.467797 6237 raft_consensus.cc:348] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } }
I20260810 06:40:53.468055 6237 raft_consensus.cc:374] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:53.468134 6237 raft_consensus.cc:729] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363a51d7b4494d40870356b269747c07, State: Initialized, Role: FOLLOWER
I20260810 06:40:53.468317 6237 consensus_queue.cc:260] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } }
I20260810 06:40:53.468710 6237 ts_tablet_manager.cc:1428] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:40:53.468743 6238 raft_consensus.cc:348] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } }
I20260810 06:40:53.468891 6238 raft_consensus.cc:374] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:53.468923 6198 heartbeater.cc:503] Master 127.27.41.190:38269 was elected leader, sending a full tablet report...
I20260810 06:40:53.468930 6238 raft_consensus.cc:729] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54e5889625e407694e3ac3b6c4d8612, State: Initialized, Role: FOLLOWER
I20260810 06:40:53.469038 6238 consensus_queue.cc:260] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } }
I20260810 06:40:53.469290 6238 ts_tablet_manager.cc:1428] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 06:40:53.469452 6013 heartbeater.cc:503] Master 127.27.41.190:38269 was elected leader, sending a full tablet report...
W20260810 06:40:53.499297 6014 tablet.cc:2369] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:40:53.594748 5822 tablet.cc:2369] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:40:53.624065 6247 raft_consensus.cc:482] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:53.624231 6247 raft_consensus.cc:504] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } }
I20260810 06:40:53.624639 6247 leader_election.cc:288] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129:44331), c54e5889625e407694e3ac3b6c4d8612 (127.27.41.130:32789)
I20260810 06:40:53.627557 6235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.624953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:54453 (local address 127.27.41.130:32789)
0810 06:40:53.624998 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.624999 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.625019 (+ 20us) server_negotiation.cc:407] Connection header received
0810 06:40:53.625083 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.625084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.625093 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.625152 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:53.625317 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.625834 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.626808 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.627185 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.627273 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.627282 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.627445 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.627480 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 06:40:53.627581 6059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.624871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:32789 (local address 127.27.41.131:54453)
0810 06:40:53.624943 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.624954 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.625008 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.625160 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.625160 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.625162 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:53.625239 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.625241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.625930 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.625931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.626682 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.626683 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.627270 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.627271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.627368 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.627371 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.627439 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.627481 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 06:40:53.627969 6232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.624923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:35281 (local address 127.27.41.129:44331)
0810 06:40:53.624979 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.624981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.625152 (+ 171us) server_negotiation.cc:407] Connection header received
0810 06:40:53.625238 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.625239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.625249 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.625306 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:53.625559 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.626087 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.627131 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.627554 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.627662 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.627670 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.627859 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.627903 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 06:40:53.627954 5954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38efa4427db942ac9f3c5bb838a34e56" candidate_uuid: "363a51d7b4494d40870356b269747c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54e5889625e407694e3ac3b6c4d8612" is_pre_election: true
I20260810 06:40:53.628105 5954 raft_consensus.cc:2454] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363a51d7b4494d40870356b269747c07 in term 0.
I20260810 06:40:53.628278 6251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.624871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:44331 (local address 127.27.41.131:35281)
0810 06:40:53.625068 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.625077 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.625162 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.625319 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.625320 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.625358 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:53.625474 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.625476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.626195 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.626196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.627021 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.627023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.627652 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.627653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.627747 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.627753 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.628090 (+ 337us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.628149 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":15,"thread_start_us":104,"threads_started":1}
I20260810 06:40:53.628346 6046 leader_election.cc:302] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363a51d7b4494d40870356b269747c07, c54e5889625e407694e3ac3b6c4d8612; no voters:
I20260810 06:40:53.628532 6247 raft_consensus.cc:2781] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:53.628600 6247 raft_consensus.cc:482] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:53.628631 6247 raft_consensus.cc:3037] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:53.628648 5737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38efa4427db942ac9f3c5bb838a34e56" candidate_uuid: "363a51d7b4494d40870356b269747c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6164767a5f34522a3dddbf1440d9a46" is_pre_election: true
I20260810 06:40:53.628798 5737 raft_consensus.cc:2454] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363a51d7b4494d40870356b269747c07 in term 0.
I20260810 06:40:53.629908 6247 raft_consensus.cc:504] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } }
I20260810 06:40:53.630057 6247 leader_election.cc:288] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [CANDIDATE]: Term 1 election: Requested vote from peers b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129:44331), c54e5889625e407694e3ac3b6c4d8612 (127.27.41.130:32789)
I20260810 06:40:53.630223 5737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38efa4427db942ac9f3c5bb838a34e56" candidate_uuid: "363a51d7b4494d40870356b269747c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6164767a5f34522a3dddbf1440d9a46"
I20260810 06:40:53.630270 5954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38efa4427db942ac9f3c5bb838a34e56" candidate_uuid: "363a51d7b4494d40870356b269747c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54e5889625e407694e3ac3b6c4d8612"
I20260810 06:40:53.630306 5737 raft_consensus.cc:3037] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:53.630338 5954 raft_consensus.cc:3037] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:53.631244 5954 raft_consensus.cc:2454] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363a51d7b4494d40870356b269747c07 in term 1.
I20260810 06:40:53.631244 5737 raft_consensus.cc:2454] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363a51d7b4494d40870356b269747c07 in term 1.
I20260810 06:40:53.631448 6046 leader_election.cc:302] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363a51d7b4494d40870356b269747c07, c54e5889625e407694e3ac3b6c4d8612; no voters:
I20260810 06:40:53.631568 6247 raft_consensus.cc:2781] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:53.631713 6247 raft_consensus.cc:686] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [term 1 LEADER]: Becoming Leader. State: Replica: 363a51d7b4494d40870356b269747c07, State: Running, Role: LEADER
I20260810 06:40:53.631814 6247 consensus_queue.cc:237] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } }
I20260810 06:40:53.632653 5533 catalog_manager.cc:5495] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 363a51d7b4494d40870356b269747c07 (127.27.41.131). New cstate: current_term: 1 leader_uuid: "363a51d7b4494d40870356b269747c07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } health_report { overall_health: UNKNOWN } } }
I20260810 06:40:53.639772 6233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.637429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38046 (local address 127.27.41.131:40551)
0810 06:40:53.637488 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.637491 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.637501 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:40:53.637573 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.637574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.637594 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.637668 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:53.637812 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.638253 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.638995 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.639187 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.639285 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.639464 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:53.639582 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:53.639659 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.639682 (+ 23us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.639700 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 06:40:53.642271 5737 raft_consensus.cc:1261] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Refusing update from remote peer 363a51d7b4494d40870356b269747c07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:53.642271 5954 raft_consensus.cc:1261] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Refusing update from remote peer 363a51d7b4494d40870356b269747c07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:53.642613 6252 consensus_queue.cc:1035] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:53.642725 6247 consensus_queue.cc:1035] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:53.645442 6257 mvcc.cc:205] Tried to move back new op lower bound from 7316865243716173824 to 7316865243676585984. Current Snapshot: MvccSnapshot[applied={T|T < 7316865243716173824}]
I20260810 06:40:53.648062 5533 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58252:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:53.648154 5533 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58252:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:53.648964 5533 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a: Sending DeleteTablet for 3 replicas of tablet 38efa4427db942ac9f3c5bb838a34e56
I20260810 06:40:53.649319 5926 tablet_service.cc:1514] Processing DeleteTablet for tablet 38efa4427db942ac9f3c5bb838a34e56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:53 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:56726
I20260810 06:40:53.649317 5729 tablet_service.cc:1514] Processing DeleteTablet for tablet 38efa4427db942ac9f3c5bb838a34e56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:53 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:43192
I20260810 06:40:53.649565 6269 tablet_replica.cc:330] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46: stopping tablet replica
I20260810 06:40:53.649504 5533 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58252:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 06:40:53.649559 6109 tablet_service.cc:1514] Processing DeleteTablet for tablet 38efa4427db942ac9f3c5bb838a34e56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:53 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:38036
W20260810 06:40:53.649657 5533 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:53.649668 6269 raft_consensus.cc:2229] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:53.649770 6269 raft_consensus.cc:2258] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:53.650569 6269 ts_tablet_manager.cc:1905] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:53.650863 5729 tablet_service.cc:1467] Processing CreateTablet for tablet ccd59634db354213a77ee9e6f2d1c5c7 (DEFAULT_TABLE table=test-table [id=0899756b5290457f9e86427cb2bebdb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:53.650959 5926 tablet_service.cc:1467] Processing CreateTablet for tablet ccd59634db354213a77ee9e6f2d1c5c7 (DEFAULT_TABLE table=test-table [id=0899756b5290457f9e86427cb2bebdb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:53.651005 5729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccd59634db354213a77ee9e6f2d1c5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:53.651082 5926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccd59634db354213a77ee9e6f2d1c5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:53.652417 6236 tablet_bootstrap.cc:492] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46: Bootstrap starting.
I20260810 06:40:53.652427 6269 ts_tablet_manager.cc:1918] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:53.652521 6269 log.cc:1196] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/wal/wals/38efa4427db942ac9f3c5bb838a34e56
I20260810 06:40:53.652721 6238 tablet_bootstrap.cc:492] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612: Bootstrap starting.
I20260810 06:40:53.652833 6269 ts_tablet_manager.cc:1939] T 38efa4427db942ac9f3c5bb838a34e56 P b6164767a5f34522a3dddbf1440d9a46: Deleting consensus metadata
I20260810 06:40:53.652849 6109 tablet_service.cc:1467] Processing CreateTablet for tablet ccd59634db354213a77ee9e6f2d1c5c7 (DEFAULT_TABLE table=test-table [id=0899756b5290457f9e86427cb2bebdb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:53.652915 6236 tablet_bootstrap.cc:654] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:53.652985 6109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccd59634db354213a77ee9e6f2d1c5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:53.653191 6238 tablet_bootstrap.cc:654] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:53.653460 5514 catalog_manager.cc:4841] TS b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129:44331): tablet 38efa4427db942ac9f3c5bb838a34e56 (table test-table [id=e44a94f144b4484989474daf508d188e]) successfully deleted
I20260810 06:40:53.653671 6236 tablet_bootstrap.cc:492] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46: No bootstrap required, opened a new log
I20260810 06:40:53.653724 6236 ts_tablet_manager.cc:1397] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:53.653878 6236 raft_consensus.cc:348] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.653978 6236 raft_consensus.cc:374] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:53.654016 6236 raft_consensus.cc:729] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6164767a5f34522a3dddbf1440d9a46, State: Initialized, Role: FOLLOWER
I20260810 06:40:53.654071 6236 consensus_queue.cc:260] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.654202 6236 ts_tablet_manager.cc:1428] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:53.654428 6237 tablet_bootstrap.cc:492] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07: Bootstrap starting.
I20260810 06:40:53.654956 6237 tablet_bootstrap.cc:654] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:53.655875 6237 tablet_bootstrap.cc:492] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07: No bootstrap required, opened a new log
I20260810 06:40:53.655939 6237 ts_tablet_manager.cc:1397] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:40:53.656091 6237 raft_consensus.cc:348] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.656172 6237 raft_consensus.cc:374] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:53.656194 6237 raft_consensus.cc:729] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363a51d7b4494d40870356b269747c07, State: Initialized, Role: FOLLOWER
I20260810 06:40:53.656234 6237 consensus_queue.cc:260] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.656339 6237 ts_tablet_manager.cc:1428] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:53.657570 6244 raft_consensus.cc:482] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:53.657629 6244 raft_consensus.cc:504] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.657717 6271 tablet_replica.cc:330] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07: stopping tablet replica
I20260810 06:40:53.657801 6238 tablet_bootstrap.cc:492] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612: No bootstrap required, opened a new log
I20260810 06:40:53.657832 6271 raft_consensus.cc:2229] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:40:53.657846 6238 ts_tablet_manager.cc:1397] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260810 06:40:53.657877 6244 leader_election.cc:288] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c54e5889625e407694e3ac3b6c4d8612 (127.27.41.130:32789), 363a51d7b4494d40870356b269747c07 (127.27.41.131:40551)
I20260810 06:40:53.657990 6271 raft_consensus.cc:2258] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:53.658012 6238 raft_consensus.cc:348] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.658087 6238 raft_consensus.cc:374] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:53.658111 6238 raft_consensus.cc:729] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54e5889625e407694e3ac3b6c4d8612, State: Initialized, Role: FOLLOWER
I20260810 06:40:53.658147 6270 tablet_replica.cc:330] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612: stopping tablet replica
I20260810 06:40:53.658164 6238 consensus_queue.cc:260] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.658246 6270 raft_consensus.cc:2229] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:53.658262 6238 ts_tablet_manager.cc:1428] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:53.658349 6270 raft_consensus.cc:2258] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:53.659050 6270 ts_tablet_manager.cc:1905] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:53.660403 6270 ts_tablet_manager.cc:1918] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:53.660481 6270 log.cc:1196] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/38efa4427db942ac9f3c5bb838a34e56
I20260810 06:40:53.660519 6271 ts_tablet_manager.cc:1905] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:53.660799 6270 ts_tablet_manager.cc:1939] T 38efa4427db942ac9f3c5bb838a34e56 P c54e5889625e407694e3ac3b6c4d8612: Deleting consensus metadata
I20260810 06:40:53.661306 5511 catalog_manager.cc:4841] TS c54e5889625e407694e3ac3b6c4d8612 (127.27.41.130:32789): tablet 38efa4427db942ac9f3c5bb838a34e56 (table test-table [id=e44a94f144b4484989474daf508d188e]) successfully deleted
I20260810 06:40:53.662570 6271 ts_tablet_manager.cc:1918] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:53.662708 6271 log.cc:1196] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/38efa4427db942ac9f3c5bb838a34e56
I20260810 06:40:53.663226 6271 ts_tablet_manager.cc:1939] T 38efa4427db942ac9f3c5bb838a34e56 P 363a51d7b4494d40870356b269747c07: Deleting consensus metadata
I20260810 06:40:53.663780 5511 catalog_manager.cc:4841] TS 363a51d7b4494d40870356b269747c07 (127.27.41.131:40551): tablet 38efa4427db942ac9f3c5bb838a34e56 (table test-table [id=e44a94f144b4484989474daf508d188e]) successfully deleted
I20260810 06:40:53.665504 6235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.658126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:38847 (local address 127.27.41.130:32789)
0810 06:40:53.658169 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.658172 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.661732 (+ 3560us) server_negotiation.cc:407] Connection header received
0810 06:40:53.661817 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.661818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.661828 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.661876 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:53.662088 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.662823 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.664470 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.665062 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.665109 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.665118 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.665401 (+ 283us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.665440 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:40:53.665566 6233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.658372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:43337 (local address 127.27.41.131:40551)
0810 06:40:53.658407 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.658409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.661918 (+ 3509us) server_negotiation.cc:407] Connection header received
0810 06:40:53.662028 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.662029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.662042 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.662075 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:53.662317 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.663149 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.664574 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.665208 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.665279 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.665288 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.665465 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.665500 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 06:40:53.665586 6275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.658239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:40551 (local address 127.27.41.129:43337)
0810 06:40:53.661847 (+ 3608us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.661859 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.661947 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.662141 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.662142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.662143 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:53.662230 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.662232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.663309 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.663311 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.664473 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.664484 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.665279 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.665281 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.665386 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.665390 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.665452 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.665498 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3596,"thread_start_us":62,"threads_started":1}
I20260810 06:40:53.665714 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.658085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:32789 (local address 127.27.41.129:38847)
0810 06:40:53.661642 (+ 3557us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.661657 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.661748 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.661936 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.661937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.661939 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:53.662009 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.662011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.662943 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.662944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.664366 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.664369 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.665198 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.665199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.665282 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.665286 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.665581 (+ 295us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.665634 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3529,"thread_start_us":49,"threads_started":1}
I20260810 06:40:53.665966 5954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccd59634db354213a77ee9e6f2d1c5c7" candidate_uuid: "b6164767a5f34522a3dddbf1440d9a46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54e5889625e407694e3ac3b6c4d8612" is_pre_election: true
I20260810 06:40:53.666049 5954 raft_consensus.cc:2454] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6164767a5f34522a3dddbf1440d9a46 in term 0.
I20260810 06:40:53.666229 5658 leader_election.cc:302] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6164767a5f34522a3dddbf1440d9a46, c54e5889625e407694e3ac3b6c4d8612; no voters:
I20260810 06:40:53.666368 6244 raft_consensus.cc:2781] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:53.666339 6136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccd59634db354213a77ee9e6f2d1c5c7" candidate_uuid: "b6164767a5f34522a3dddbf1440d9a46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363a51d7b4494d40870356b269747c07" is_pre_election: true
I20260810 06:40:53.666409 6244 raft_consensus.cc:482] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:53.666431 6136 raft_consensus.cc:2454] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6164767a5f34522a3dddbf1440d9a46 in term 0.
I20260810 06:40:53.666460 6244 raft_consensus.cc:3037] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:53.667104 6244 raft_consensus.cc:504] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.667220 6244 leader_election.cc:288] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [CANDIDATE]: Term 1 election: Requested vote from peers c54e5889625e407694e3ac3b6c4d8612 (127.27.41.130:32789), 363a51d7b4494d40870356b269747c07 (127.27.41.131:40551)
I20260810 06:40:53.667403 5954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccd59634db354213a77ee9e6f2d1c5c7" candidate_uuid: "b6164767a5f34522a3dddbf1440d9a46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54e5889625e407694e3ac3b6c4d8612"
I20260810 06:40:53.667482 5954 raft_consensus.cc:3037] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:53.667469 6136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccd59634db354213a77ee9e6f2d1c5c7" candidate_uuid: "b6164767a5f34522a3dddbf1440d9a46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363a51d7b4494d40870356b269747c07"
I20260810 06:40:53.667534 6136 raft_consensus.cc:3037] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:53.668030 5954 raft_consensus.cc:2454] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6164767a5f34522a3dddbf1440d9a46 in term 1.
I20260810 06:40:53.668212 5658 leader_election.cc:302] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6164767a5f34522a3dddbf1440d9a46, c54e5889625e407694e3ac3b6c4d8612; no voters:
I20260810 06:40:53.668247 6136 raft_consensus.cc:2454] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6164767a5f34522a3dddbf1440d9a46 in term 1.
I20260810 06:40:53.668421 6244 raft_consensus.cc:2781] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:53.668581 6244 raft_consensus.cc:686] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [term 1 LEADER]: Becoming Leader. State: Replica: b6164767a5f34522a3dddbf1440d9a46, State: Running, Role: LEADER
I20260810 06:40:53.668653 6244 consensus_queue.cc:237] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.669263 5533 catalog_manager.cc:5495] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129). New cstate: current_term: 1 leader_uuid: "b6164767a5f34522a3dddbf1440d9a46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } health_report { overall_health: UNKNOWN } } }
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344052, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.190@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
I20260810 06:40:53.706051 6288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.698141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38269 (local address 127.0.0.1:58266)
0810 06:40:53.698312 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.698324 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.698394 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.698560 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.698561 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.698872 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:53.698934 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.698936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.699863 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.699863 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.700429 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.700430 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.700926 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.700927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.700995 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.701708 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:53.701714 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:53.703174 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:53.704920 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.704928 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.704929 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.705128 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.705402 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:53.705408 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:53.705408 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:53.705479 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:53.705754 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:53.705761 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:53.705804 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.705861 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.705966 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":108,"threads_started":1}
I20260810 06:40:53.706146 5633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.698220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58266 (local address 127.27.41.190:38269)
0810 06:40:53.698293 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.698295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.698396 (+ 101us) server_negotiation.cc:407] Connection header received
0810 06:40:53.698453 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.698454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.698467 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.698538 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:53.699017 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.699775 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.700509 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.700839 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.700910 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.703266 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:53.703267 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:53.703268 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:53.703275 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:53.704830 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.705202 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.705203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.705203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.705265 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.705552 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.705553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.705553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.705684 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:53.705753 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.705906 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.706031 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":41}
I20260810 06:40:53.708397 5533 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:58266:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 06:40:53.708631 5533 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:53.710305 5729 tablet_service.cc:1467] Processing CreateTablet for tablet 0e85d33a0cc64b6fab55ce1698256bff (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=857b7923009242e5a6c40c37e5b4d5c3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:40:53.710307 5926 tablet_service.cc:1467] Processing CreateTablet for tablet 0e85d33a0cc64b6fab55ce1698256bff (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=857b7923009242e5a6c40c37e5b4d5c3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:40:53.710359 6109 tablet_service.cc:1467] Processing CreateTablet for tablet 0e85d33a0cc64b6fab55ce1698256bff (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=857b7923009242e5a6c40c37e5b4d5c3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:40:53.710481 5729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e85d33a0cc64b6fab55ce1698256bff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:53.710494 5926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e85d33a0cc64b6fab55ce1698256bff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:53.710505 6109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e85d33a0cc64b6fab55ce1698256bff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:53.712074 6236 tablet_bootstrap.cc:492] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46: Bootstrap starting.
I20260810 06:40:53.712105 6237 tablet_bootstrap.cc:492] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07: Bootstrap starting.
I20260810 06:40:53.712481 6237 tablet_bootstrap.cc:654] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:53.712500 6236 tablet_bootstrap.cc:654] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:53.712834 6238 tablet_bootstrap.cc:492] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612: Bootstrap starting.
I20260810 06:40:53.713299 6238 tablet_bootstrap.cc:654] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:53.713672 6236 tablet_bootstrap.cc:492] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46: No bootstrap required, opened a new log
I20260810 06:40:53.713726 6236 ts_tablet_manager.cc:1397] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:40:53.713894 6236 raft_consensus.cc:348] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.714007 6236 raft_consensus.cc:374] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:53.714040 6236 raft_consensus.cc:729] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6164767a5f34522a3dddbf1440d9a46, State: Initialized, Role: FOLLOWER
I20260810 06:40:53.714092 6236 consensus_queue.cc:260] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.714207 6237 tablet_bootstrap.cc:492] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07: No bootstrap required, opened a new log
I20260810 06:40:53.714211 6236 ts_tablet_manager.cc:1428] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:53.714252 6237 ts_tablet_manager.cc:1397] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:40:53.714277 6244 tablet_replica.cc:439] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } }
I20260810 06:40:53.714370 6244 tablet_replica.cc:442] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:53.714413 6237 raft_consensus.cc:348] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.714483 6237 raft_consensus.cc:374] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:53.714497 6237 raft_consensus.cc:729] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363a51d7b4494d40870356b269747c07, State: Initialized, Role: FOLLOWER
I20260810 06:40:53.714567 6237 consensus_queue.cc:260] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.714707 6237 ts_tablet_manager.cc:1428] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:53.714738 6263 tablet_replica.cc:439] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } }
I20260810 06:40:53.714833 6263 tablet_replica.cc:442] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:53.715337 6238 tablet_bootstrap.cc:492] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612: No bootstrap required, opened a new log
I20260810 06:40:53.715399 6238 ts_tablet_manager.cc:1397] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 06:40:53.715590 6238 raft_consensus.cc:348] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.715651 6238 raft_consensus.cc:374] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:53.715665 6238 raft_consensus.cc:729] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54e5889625e407694e3ac3b6c4d8612, State: Initialized, Role: FOLLOWER
I20260810 06:40:53.715721 6238 consensus_queue.cc:260] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.715826 6238 ts_tablet_manager.cc:1428] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:53.715898 6248 tablet_replica.cc:439] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } }
I20260810 06:40:53.716048 6248 tablet_replica.cc:442] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:53.754333 6248 raft_consensus.cc:482] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:53.754463 6248 raft_consensus.cc:504] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.754810 6248 leader_election.cc:288] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129:44331), 363a51d7b4494d40870356b269747c07 (127.27.41.131:40551)
I20260810 06:40:53.758438 6232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.755139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:48429 (local address 127.27.41.129:44331)
0810 06:40:53.755194 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.755197 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.755206 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:53.755238 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.755239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.755248 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.755306 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:53.755583 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.756302 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.757598 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.758004 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.758116 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.758127 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.758310 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.758369 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 06:40:53.758462 6294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.754951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:44331 (local address 127.27.41.130:48429)
0810 06:40:53.755079 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.755091 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.755149 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.755350 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.755351 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.755354 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:53.755433 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.755436 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.756390 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.756391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.757488 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.757490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.758119 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.758120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.758200 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.758206 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.758290 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.758345 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":55,"threads_started":1}
I20260810 06:40:53.758527 6233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.755146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:39851 (local address 127.27.41.131:40551)
0810 06:40:53.755188 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.755190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.755304 (+ 114us) server_negotiation.cc:407] Connection header received
0810 06:40:53.755409 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.755410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.755421 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.755476 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:40:53.755608 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.756098 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.757572 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.758160 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.758245 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.758253 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.758409 (+ 156us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.758452 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:40:53.758721 6295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.754982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:40551 (local address 127.27.41.130:39851)
0810 06:40:53.755235 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.755249 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.755314 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.755490 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.755491 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.755493 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:40:53.755550 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.755551 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.756193 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.756194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.757478 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.757481 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.758241 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.758242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.758315 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.758318 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.758601 (+ 283us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.758649 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":61,"threads_started":1}
I20260810 06:40:53.758909 5737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e85d33a0cc64b6fab55ce1698256bff" candidate_uuid: "c54e5889625e407694e3ac3b6c4d8612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6164767a5f34522a3dddbf1440d9a46" is_pre_election: true
I20260810 06:40:53.759029 5737 raft_consensus.cc:2454] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54e5889625e407694e3ac3b6c4d8612 in term 0.
I20260810 06:40:53.759112 6136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e85d33a0cc64b6fab55ce1698256bff" candidate_uuid: "c54e5889625e407694e3ac3b6c4d8612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363a51d7b4494d40870356b269747c07" is_pre_election: true
I20260810 06:40:53.759243 6136 raft_consensus.cc:2454] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54e5889625e407694e3ac3b6c4d8612 in term 0.
I20260810 06:40:53.759207 5863 leader_election.cc:302] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6164767a5f34522a3dddbf1440d9a46, c54e5889625e407694e3ac3b6c4d8612; no voters:
I20260810 06:40:53.759333 6248 raft_consensus.cc:2781] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:53.759373 6248 raft_consensus.cc:482] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:53.759393 6248 raft_consensus.cc:3037] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:53.760310 6248 raft_consensus.cc:504] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.760455 6248 leader_election.cc:288] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [CANDIDATE]: Term 1 election: Requested vote from peers b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129:44331), 363a51d7b4494d40870356b269747c07 (127.27.41.131:40551)
I20260810 06:40:53.760612 5737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e85d33a0cc64b6fab55ce1698256bff" candidate_uuid: "c54e5889625e407694e3ac3b6c4d8612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6164767a5f34522a3dddbf1440d9a46"
I20260810 06:40:53.760697 5737 raft_consensus.cc:3037] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:53.760701 6136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e85d33a0cc64b6fab55ce1698256bff" candidate_uuid: "c54e5889625e407694e3ac3b6c4d8612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363a51d7b4494d40870356b269747c07"
I20260810 06:40:53.760792 6136 raft_consensus.cc:3037] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:53.761574 6136 raft_consensus.cc:2454] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54e5889625e407694e3ac3b6c4d8612 in term 1.
I20260810 06:40:53.761593 5737 raft_consensus.cc:2454] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54e5889625e407694e3ac3b6c4d8612 in term 1.
I20260810 06:40:53.761755 5863 leader_election.cc:302] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6164767a5f34522a3dddbf1440d9a46, c54e5889625e407694e3ac3b6c4d8612; no voters:
I20260810 06:40:53.761857 6248 raft_consensus.cc:2781] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:53.761976 6248 raft_consensus.cc:686] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [term 1 LEADER]: Becoming Leader. State: Replica: c54e5889625e407694e3ac3b6c4d8612, State: Running, Role: LEADER
I20260810 06:40:53.762044 6248 consensus_queue.cc:237] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.762516 6297 tablet_replica.cc:439] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612: TxnStatusTablet state changed. Reason: New leader c54e5889625e407694e3ac3b6c4d8612. Latest consensus state: current_term: 1 leader_uuid: "c54e5889625e407694e3ac3b6c4d8612" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } }
I20260810 06:40:53.762598 6297 tablet_replica.cc:442] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:40:53.762732 6300 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 06:40:53.762843 6300 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 06:40:53.762797 5530 catalog_manager.cc:5495] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 reported cstate change: term changed from 0 to 1, leader changed from <none> to c54e5889625e407694e3ac3b6c4d8612 (127.27.41.130). New cstate: current_term: 1 leader_uuid: "c54e5889625e407694e3ac3b6c4d8612" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } health_report { overall_health: UNKNOWN } } }
I20260810 06:40:53.777415 6235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.774125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56728 (local address 127.27.41.130:32789)
0810 06:40:53.774296 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.774298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.774306 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:40:53.774338 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.774338 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.774356 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.774415 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:53.774577 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.775379 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.776502 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.776767 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.776849 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.777060 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:53.777167 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:53.777228 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.777283 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.777313 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260810 06:40:53.777448 6288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.774075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:32789 (local address 127.0.0.1:56728)
0810 06:40:53.774155 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.774166 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.774208 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.774442 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.774444 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.774445 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:40:53.774497 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.774500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.775450 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.775452 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.776418 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.776421 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.776858 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.776859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.776932 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.776949 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:40:53.777228 (+ 279us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:40:53.777236 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.777281 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.777340 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 06:40:53.778541 5737 raft_consensus.cc:1261] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Refusing update from remote peer c54e5889625e407694e3ac3b6c4d8612: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:53.778571 6136 raft_consensus.cc:1261] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Refusing update from remote peer c54e5889625e407694e3ac3b6c4d8612: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:53.778772 6248 consensus_queue.cc:1035] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:53.778929 6248 consensus_queue.cc:1035] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:53.779518 6263 tablet_replica.cc:439] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07: TxnStatusTablet state changed. Reason: New leader c54e5889625e407694e3ac3b6c4d8612. Latest consensus state: current_term: 1 leader_uuid: "c54e5889625e407694e3ac3b6c4d8612" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } }
I20260810 06:40:53.779606 6263 tablet_replica.cc:442] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:53.779834 6244 tablet_replica.cc:439] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46: TxnStatusTablet state changed. Reason: New leader c54e5889625e407694e3ac3b6c4d8612. Latest consensus state: current_term: 1 leader_uuid: "c54e5889625e407694e3ac3b6c4d8612" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } }
I20260810 06:40:53.779937 6244 tablet_replica.cc:442] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:53.780800 6297 tablet_replica.cc:439] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c54e5889625e407694e3ac3b6c4d8612" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } }
I20260810 06:40:53.780889 6297 tablet_replica.cc:442] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:40:53.781402 6248 tablet_replica.cc:439] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c54e5889625e407694e3ac3b6c4d8612" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } }
I20260810 06:40:53.781486 6248 tablet_replica.cc:442] T 0e85d33a0cc64b6fab55ce1698256bff P c54e5889625e407694e3ac3b6c4d8612: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:40:53.781702 6259 mvcc.cc:205] Tried to move back new op lower bound from 7316865244274925568 to 7316865244209852416. Current Snapshot: MvccSnapshot[applied={T|T < 7316865244274925568 or (T in {7316865244274925568})}]
I20260810 06:40:53.781824 6244 tablet_replica.cc:439] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c54e5889625e407694e3ac3b6c4d8612" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } }
I20260810 06:40:53.781896 6244 tablet_replica.cc:442] T 0e85d33a0cc64b6fab55ce1698256bff P b6164767a5f34522a3dddbf1440d9a46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:53.782068 6263 tablet_replica.cc:439] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c54e5889625e407694e3ac3b6c4d8612" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } } }
I20260810 06:40:53.782151 6263 tablet_replica.cc:442] T 0e85d33a0cc64b6fab55ce1698256bff P 363a51d7b4494d40870356b269747c07: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:40:53.785244 6232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.782806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43208 (local address 127.27.41.129:44331)
0810 06:40:53.782850 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.782852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.782861 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:53.782893 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.782893 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.782912 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.783029 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:53.783135 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.783673 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.784424 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.784626 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.784703 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.784882 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:53.784995 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:53.785078 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.785128 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.785149 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:40:53.790849 6235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.788107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:58173 (local address 127.27.41.130:32789)
0810 06:40:53.788145 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.788147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.788297 (+ 150us) server_negotiation.cc:407] Connection header received
0810 06:40:53.788321 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.788322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.788332 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.788384 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:53.788539 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.789252 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.790008 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.790308 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.790388 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.790613 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:53.790646 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:53.790702 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.790763 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.790782 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:40:53.790880 6309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.787985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:32789 (local address 127.27.41.129:58173)
0810 06:40:53.788185 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.788196 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.788259 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.788393 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.788394 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.788395 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:40:53.788465 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.788466 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.789322 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.789323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.789924 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.789925 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.790423 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.790424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.790493 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.790510 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:40:53.790714 (+ 204us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:40:53.790716 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.790761 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.790801 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":131,"threads_started":1}
I20260810 06:40:53.793373 5954 raft_consensus.cc:1261] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Refusing update from remote peer b6164767a5f34522a3dddbf1440d9a46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:53.793394 6136 raft_consensus.cc:1261] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Refusing update from remote peer b6164767a5f34522a3dddbf1440d9a46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:53.793711 6277 consensus_queue.cc:1035] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:53.793867 6244 consensus_queue.cc:1035] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:53.795578 6258 mvcc.cc:205] Tried to move back new op lower bound from 7316865244335677440 to 7316865243827404800. Current Snapshot: MvccSnapshot[applied={T|T < 7316865244335677440}]
I20260810 06:40:53.804893 6232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.801885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:59761 (local address 127.27.41.129:44331)
0810 06:40:53.801940 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.801943 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.802101 (+ 158us) server_negotiation.cc:407] Connection header received
0810 06:40:53.802164 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.802165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.802178 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.802238 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:53.802375 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.802865 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.804049 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.804273 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.804336 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.804580 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:53.804636 (+ 56us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:53.804696 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.804804 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.804826 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 06:40:53.805018 6316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.801843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:44331 (local address 127.27.41.130:59761)
0810 06:40:53.802038 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:53.802049 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:53.802110 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:53.802251 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:53.802251 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:53.802253 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:40:53.802319 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.802321 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.802965 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.802966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.803935 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:53.803937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.804355 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.804356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:53.804427 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.804442 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:40:53.804726 (+ 284us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:40:53.804729 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:40:53.804783 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 06:40:53.804837 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":118,"threads_started":1}
I20260810 06:40:53.812578 5528 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58252:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:53.812724 5528 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58252:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:53.813427 5528 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a: Sending DeleteTablet for 3 replicas of tablet ccd59634db354213a77ee9e6f2d1c5c7
I20260810 06:40:53.813752 5729 tablet_service.cc:1514] Processing DeleteTablet for tablet ccd59634db354213a77ee9e6f2d1c5c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:53 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:43192
I20260810 06:40:53.813771 6109 tablet_service.cc:1514] Processing DeleteTablet for tablet ccd59634db354213a77ee9e6f2d1c5c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:53 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:38036
I20260810 06:40:53.813846 5926 tablet_service.cc:1514] Processing DeleteTablet for tablet ccd59634db354213a77ee9e6f2d1c5c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:53 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:56726
I20260810 06:40:53.813868 6271 tablet_replica.cc:330] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07: stopping tablet replica
I20260810 06:40:53.813865 6269 tablet_replica.cc:330] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46: stopping tablet replica
I20260810 06:40:53.813913 6271 raft_consensus.cc:2229] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:53.813930 6269 raft_consensus.cc:2229] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:40:53.813949 6271 raft_consensus.cc:2258] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:53.813943 6270 tablet_replica.cc:330] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612: stopping tablet replica
I20260810 06:40:53.814005 6270 raft_consensus.cc:2229] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:53.814021 6269 raft_consensus.cc:2258] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:53.814043 6270 raft_consensus.cc:2258] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:53.814308 6271 ts_tablet_manager.cc:1905] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:53.814333 6269 ts_tablet_manager.cc:1905] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:53.814591 6270 ts_tablet_manager.cc:1905] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:53.816279 6270 ts_tablet_manager.cc:1918] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:53.816279 6269 ts_tablet_manager.cc:1918] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:53.816341 6269 log.cc:1196] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/wal/wals/ccd59634db354213a77ee9e6f2d1c5c7
I20260810 06:40:53.816341 6270 log.cc:1196] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/ccd59634db354213a77ee9e6f2d1c5c7
I20260810 06:40:53.816609 6270 ts_tablet_manager.cc:1939] T ccd59634db354213a77ee9e6f2d1c5c7 P c54e5889625e407694e3ac3b6c4d8612: Deleting consensus metadata
I20260810 06:40:53.816612 6269 ts_tablet_manager.cc:1939] T ccd59634db354213a77ee9e6f2d1c5c7 P b6164767a5f34522a3dddbf1440d9a46: Deleting consensus metadata
I20260810 06:40:53.816931 6271 ts_tablet_manager.cc:1918] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:53.816998 6271 log.cc:1196] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/ccd59634db354213a77ee9e6f2d1c5c7
I20260810 06:40:53.816983 5514 catalog_manager.cc:4841] TS b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129:44331): tablet ccd59634db354213a77ee9e6f2d1c5c7 (table test-table [id=0899756b5290457f9e86427cb2bebdb9]) successfully deleted
I20260810 06:40:53.817252 6271 ts_tablet_manager.cc:1939] T ccd59634db354213a77ee9e6f2d1c5c7 P 363a51d7b4494d40870356b269747c07: Deleting consensus metadata
I20260810 06:40:53.817366 5511 catalog_manager.cc:4841] TS c54e5889625e407694e3ac3b6c4d8612 (127.27.41.130:32789): tablet ccd59634db354213a77ee9e6f2d1c5c7 (table test-table [id=0899756b5290457f9e86427cb2bebdb9]) successfully deleted
I20260810 06:40:53.817723 5511 catalog_manager.cc:4841] TS 363a51d7b4494d40870356b269747c07 (127.27.41.131:40551): tablet ccd59634db354213a77ee9e6f2d1c5c7 (table test-table [id=0899756b5290457f9e86427cb2bebdb9]) successfully deleted
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 06:40:53.842904 5633 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:53.837063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58276 (local address 127.27.41.190:38269)
0810 06:40:53.837116 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.837118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.837282 (+ 164us) server_negotiation.cc:407] Connection header received
0810 06:40:53.837406 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.837406 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.837419 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.837484 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:53.838117 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.838625 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.839418 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.839621 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.839713 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.842853 (+ 3140us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58276: BlockingRecv error: recv got EOF from 127.0.0.1:58276 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 10 06:40:53 dist-test-slave-bw88 krb5kdc[5470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM
I20260810 06:40:53.852447 5633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:53.844014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58286 (local address 127.27.41.190:38269)
0810 06:40:53.844107 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:53.844109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:53.844327 (+ 218us) server_negotiation.cc:407] Connection header received
0810 06:40:53.844411 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:53.844412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:53.844423 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:53.844484 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:53.844964 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.845581 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.846484 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:53.846678 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:53.846782 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:53.849311 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:53.849313 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:53.849313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:53.849323 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:53.851022 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.851527 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.851528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.851529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.851597 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:53.851870 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:53.851871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:53.851871 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:53.852004 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:53.852118 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:53.852254 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 06:40:53.852340 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 06:40:53.854278 5528 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:40:53.854492 5528 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:53.856119 5926 tablet_service.cc:1467] Processing CreateTablet for tablet 640118ece64a4001b632277aeafd3b28 (DEFAULT_TABLE table=test-table [id=c8a85a45871a4c378d06ba7a9a96d00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:53.856212 5729 tablet_service.cc:1467] Processing CreateTablet for tablet 640118ece64a4001b632277aeafd3b28 (DEFAULT_TABLE table=test-table [id=c8a85a45871a4c378d06ba7a9a96d00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:53.856288 5926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 640118ece64a4001b632277aeafd3b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:53.856341 5729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 640118ece64a4001b632277aeafd3b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:53.857833 6238 tablet_bootstrap.cc:492] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612: Bootstrap starting.
I20260810 06:40:53.857846 6109 tablet_service.cc:1467] Processing CreateTablet for tablet 640118ece64a4001b632277aeafd3b28 (DEFAULT_TABLE table=test-table [id=c8a85a45871a4c378d06ba7a9a96d00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:53.857983 6109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 640118ece64a4001b632277aeafd3b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:53.858202 6238 tablet_bootstrap.cc:654] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:53.859544 6237 tablet_bootstrap.cc:492] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07: Bootstrap starting.
I20260810 06:40:53.859591 6236 tablet_bootstrap.cc:492] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46: Bootstrap starting.
I20260810 06:40:53.859939 6237 tablet_bootstrap.cc:654] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:53.860066 6236 tablet_bootstrap.cc:654] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:53.860822 6236 tablet_bootstrap.cc:492] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46: No bootstrap required, opened a new log
I20260810 06:40:53.860910 6236 ts_tablet_manager.cc:1397] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:53.861095 6236 raft_consensus.cc:348] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.861203 6236 raft_consensus.cc:374] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:53.861212 6238 tablet_bootstrap.cc:492] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612: No bootstrap required, opened a new log
I20260810 06:40:53.861235 6236 raft_consensus.cc:729] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6164767a5f34522a3dddbf1440d9a46, State: Initialized, Role: FOLLOWER
I20260810 06:40:53.861259 6238 ts_tablet_manager.cc:1397] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 06:40:53.861289 6236 consensus_queue.cc:260] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.861441 6236 ts_tablet_manager.cc:1428] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:53.861514 6238 raft_consensus.cc:348] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.861610 6238 raft_consensus.cc:374] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:53.861635 6238 raft_consensus.cc:729] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54e5889625e407694e3ac3b6c4d8612, State: Initialized, Role: FOLLOWER
I20260810 06:40:53.861686 6238 consensus_queue.cc:260] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.861802 6238 ts_tablet_manager.cc:1428] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:53.863420 6237 tablet_bootstrap.cc:492] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07: No bootstrap required, opened a new log
I20260810 06:40:53.863492 6237 ts_tablet_manager.cc:1397] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260810 06:40:53.863637 6237 raft_consensus.cc:348] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.863711 6237 raft_consensus.cc:374] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:53.863729 6237 raft_consensus.cc:729] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363a51d7b4494d40870356b269747c07, State: Initialized, Role: FOLLOWER
I20260810 06:40:53.863788 6237 consensus_queue.cc:260] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:53.863896 6237 ts_tablet_manager.cc:1428] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260810 06:40:53.905709 6199 tablet.cc:2369] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:40:54.059680 6297 raft_consensus.cc:482] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:54.059821 6297 raft_consensus.cc:504] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:54.060081 6297 leader_election.cc:288] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129:44331), 363a51d7b4494d40870356b269747c07 (127.27.41.131:40551)
I20260810 06:40:54.060322 6136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "640118ece64a4001b632277aeafd3b28" candidate_uuid: "c54e5889625e407694e3ac3b6c4d8612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363a51d7b4494d40870356b269747c07" is_pre_election: true
I20260810 06:40:54.060424 6136 raft_consensus.cc:2454] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54e5889625e407694e3ac3b6c4d8612 in term 0.
I20260810 06:40:54.060319 5737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "640118ece64a4001b632277aeafd3b28" candidate_uuid: "c54e5889625e407694e3ac3b6c4d8612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6164767a5f34522a3dddbf1440d9a46" is_pre_election: true
I20260810 06:40:54.060488 5737 raft_consensus.cc:2454] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54e5889625e407694e3ac3b6c4d8612 in term 0.
I20260810 06:40:54.060616 5858 leader_election.cc:302] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363a51d7b4494d40870356b269747c07, c54e5889625e407694e3ac3b6c4d8612; no voters:
I20260810 06:40:54.060716 6297 raft_consensus.cc:2781] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:54.060750 6297 raft_consensus.cc:482] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:54.060783 6297 raft_consensus.cc:3037] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:54.061683 6297 raft_consensus.cc:504] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:54.061834 6297 leader_election.cc:288] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [CANDIDATE]: Term 1 election: Requested vote from peers b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129:44331), 363a51d7b4494d40870356b269747c07 (127.27.41.131:40551)
I20260810 06:40:54.061997 5737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "640118ece64a4001b632277aeafd3b28" candidate_uuid: "c54e5889625e407694e3ac3b6c4d8612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6164767a5f34522a3dddbf1440d9a46"
I20260810 06:40:54.062103 5737 raft_consensus.cc:3037] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:54.062331 6136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "640118ece64a4001b632277aeafd3b28" candidate_uuid: "c54e5889625e407694e3ac3b6c4d8612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363a51d7b4494d40870356b269747c07"
I20260810 06:40:54.062444 6136 raft_consensus.cc:3037] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:54.062948 5737 raft_consensus.cc:2454] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54e5889625e407694e3ac3b6c4d8612 in term 1.
I20260810 06:40:54.063171 5863 leader_election.cc:302] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6164767a5f34522a3dddbf1440d9a46, c54e5889625e407694e3ac3b6c4d8612; no voters:
I20260810 06:40:54.063359 6297 raft_consensus.cc:2781] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:54.063314 6136 raft_consensus.cc:2454] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54e5889625e407694e3ac3b6c4d8612 in term 1.
I20260810 06:40:54.063436 6297 raft_consensus.cc:686] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [term 1 LEADER]: Becoming Leader. State: Replica: c54e5889625e407694e3ac3b6c4d8612, State: Running, Role: LEADER
I20260810 06:40:54.063508 6297 consensus_queue.cc:237] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:54.064164 5530 catalog_manager.cc:5495] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 reported cstate change: term changed from 0 to 1, leader changed from <none> to c54e5889625e407694e3ac3b6c4d8612 (127.27.41.130). New cstate: current_term: 1 leader_uuid: "c54e5889625e407694e3ac3b6c4d8612" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } health_report { overall_health: UNKNOWN } } }
I20260810 06:40:54.089195 6235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:54.086834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56732 (local address 127.27.41.130:32789)
0810 06:40:54.086892 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:54.086894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:54.086903 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:54.086930 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:54.086931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:54.086942 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:54.087012 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:54.087177 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:54.087659 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:54.088482 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:54.088687 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:54.088760 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:54.088920 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:54.088959 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:54.089022 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:54.089084 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 06:40:54.089108 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 06:40:54.090200 6136 raft_consensus.cc:1261] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Refusing update from remote peer c54e5889625e407694e3ac3b6c4d8612: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:54.090221 5737 raft_consensus.cc:1261] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Refusing update from remote peer c54e5889625e407694e3ac3b6c4d8612: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:54.090461 6248 consensus_queue.cc:1035] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:54.090595 6297 consensus_queue.cc:1035] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:54.093860 5528 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:54.093953 5528 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:54.094566 5528 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a: Sending DeleteTablet for 3 replicas of tablet 640118ece64a4001b632277aeafd3b28
I20260810 06:40:54.094856 5729 tablet_service.cc:1514] Processing DeleteTablet for tablet 640118ece64a4001b632277aeafd3b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:54 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:43192
I20260810 06:40:54.094993 6269 tablet_replica.cc:330] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46: stopping tablet replica
I20260810 06:40:54.095002 5926 tablet_service.cc:1514] Processing DeleteTablet for tablet 640118ece64a4001b632277aeafd3b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:54 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:56726
I20260810 06:40:54.095048 6269 raft_consensus.cc:2229] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:54.095083 6270 tablet_replica.cc:330] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612: stopping tablet replica
I20260810 06:40:54.095089 6269 raft_consensus.cc:2258] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:54.095124 6270 raft_consensus.cc:2229] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:40:54.095160 6109 tablet_service.cc:1514] Processing DeleteTablet for tablet 640118ece64a4001b632277aeafd3b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:54 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:38036
I20260810 06:40:54.095206 6270 raft_consensus.cc:2258] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:54.095307 6271 tablet_replica.cc:330] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07: stopping tablet replica
I20260810 06:40:54.095361 6271 raft_consensus.cc:2229] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:54.095402 6271 raft_consensus.cc:2258] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:54.096141 6270 ts_tablet_manager.cc:1905] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:54.096199 6269 ts_tablet_manager.cc:1905] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:54.097720 5528 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 06:40:54.097827 6269 ts_tablet_manager.cc:1918] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:54.097880 6269 log.cc:1196] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-0/wal/wals/640118ece64a4001b632277aeafd3b28
W20260810 06:40:54.097886 5528 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:40:54.098109 6269 ts_tablet_manager.cc:1939] T 640118ece64a4001b632277aeafd3b28 P b6164767a5f34522a3dddbf1440d9a46: Deleting consensus metadata
I20260810 06:40:54.098222 6270 ts_tablet_manager.cc:1918] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:54.098275 6270 log.cc:1196] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/640118ece64a4001b632277aeafd3b28
I20260810 06:40:54.098506 6270 ts_tablet_manager.cc:1939] T 640118ece64a4001b632277aeafd3b28 P c54e5889625e407694e3ac3b6c4d8612: Deleting consensus metadata
I20260810 06:40:54.098613 6271 ts_tablet_manager.cc:1905] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:54.098788 5514 catalog_manager.cc:4841] TS b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129:44331): tablet 640118ece64a4001b632277aeafd3b28 (table test-table [id=c8a85a45871a4c378d06ba7a9a96d00e]) successfully deleted
I20260810 06:40:54.098830 5511 catalog_manager.cc:4841] TS c54e5889625e407694e3ac3b6c4d8612 (127.27.41.130:32789): tablet 640118ece64a4001b632277aeafd3b28 (table test-table [id=c8a85a45871a4c378d06ba7a9a96d00e]) successfully deleted
I20260810 06:40:54.099699 5729 tablet_service.cc:1467] Processing CreateTablet for tablet 280929a1586343ee90683bce3c2c5a86 (DEFAULT_TABLE table=test-table [id=4d1a62e1e3c34a1b85a38a288c60cdf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:54.099712 6109 tablet_service.cc:1467] Processing CreateTablet for tablet 280929a1586343ee90683bce3c2c5a86 (DEFAULT_TABLE table=test-table [id=4d1a62e1e3c34a1b85a38a288c60cdf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:54.099829 6109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 280929a1586343ee90683bce3c2c5a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:54.099829 5729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 280929a1586343ee90683bce3c2c5a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:54.100149 6271 ts_tablet_manager.cc:1918] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:40:54.100200 6271 log.cc:1196] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/640118ece64a4001b632277aeafd3b28
I20260810 06:40:54.100411 6271 ts_tablet_manager.cc:1939] T 640118ece64a4001b632277aeafd3b28 P 363a51d7b4494d40870356b269747c07: Deleting consensus metadata
I20260810 06:40:54.101007 6236 tablet_bootstrap.cc:492] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46: Bootstrap starting.
I20260810 06:40:54.101039 6237 tablet_bootstrap.cc:492] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07: Bootstrap starting.
I20260810 06:40:54.101191 5926 tablet_service.cc:1467] Processing CreateTablet for tablet 280929a1586343ee90683bce3c2c5a86 (DEFAULT_TABLE table=test-table [id=4d1a62e1e3c34a1b85a38a288c60cdf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:40:54.101289 5926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 280929a1586343ee90683bce3c2c5a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:54.101327 6236 tablet_bootstrap.cc:654] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:54.101438 6237 tablet_bootstrap.cc:654] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:54.102269 6236 tablet_bootstrap.cc:492] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46: No bootstrap required, opened a new log
I20260810 06:40:54.102316 6236 ts_tablet_manager.cc:1397] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:54.102422 6236 raft_consensus.cc:348] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:54.102486 6236 raft_consensus.cc:374] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:54.102514 6236 raft_consensus.cc:729] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6164767a5f34522a3dddbf1440d9a46, State: Initialized, Role: FOLLOWER
I20260810 06:40:54.102562 6236 consensus_queue.cc:260] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:54.102671 6236 ts_tablet_manager.cc:1428] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:54.102703 6238 tablet_bootstrap.cc:492] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612: Bootstrap starting.
I20260810 06:40:54.103039 6238 tablet_bootstrap.cc:654] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:54.103076 5511 catalog_manager.cc:4841] TS 363a51d7b4494d40870356b269747c07 (127.27.41.131:40551): tablet 640118ece64a4001b632277aeafd3b28 (table test-table [id=c8a85a45871a4c378d06ba7a9a96d00e]) successfully deleted
I20260810 06:40:54.103807 6238 tablet_bootstrap.cc:492] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612: No bootstrap required, opened a new log
I20260810 06:40:54.103861 6238 ts_tablet_manager.cc:1397] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:40:54.103928 6237 tablet_bootstrap.cc:492] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07: No bootstrap required, opened a new log
I20260810 06:40:54.103964 6237 ts_tablet_manager.cc:1397] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260810 06:40:54.103991 6238 raft_consensus.cc:348] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:54.104041 6237 raft_consensus.cc:348] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:54.104063 6238 raft_consensus.cc:374] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:54.104084 6237 raft_consensus.cc:374] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:54.104087 6238 raft_consensus.cc:729] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54e5889625e407694e3ac3b6c4d8612, State: Initialized, Role: FOLLOWER
I20260810 06:40:54.104096 6237 raft_consensus.cc:729] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363a51d7b4494d40870356b269747c07, State: Initialized, Role: FOLLOWER
I20260810 06:40:54.104133 6238 consensus_queue.cc:260] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:54.104157 6237 consensus_queue.cc:260] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:54.104223 6238 ts_tablet_manager.cc:1428] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:54.104250 6237 ts_tablet_manager.cc:1428] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:54.498159 6248 raft_consensus.cc:482] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:40:54.498270 6248 raft_consensus.cc:504] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:54.498453 6248 leader_election.cc:288] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129:44331), 363a51d7b4494d40870356b269747c07 (127.27.41.131:40551)
I20260810 06:40:54.498723 5737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280929a1586343ee90683bce3c2c5a86" candidate_uuid: "c54e5889625e407694e3ac3b6c4d8612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6164767a5f34522a3dddbf1440d9a46" is_pre_election: true
I20260810 06:40:54.498708 6136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280929a1586343ee90683bce3c2c5a86" candidate_uuid: "c54e5889625e407694e3ac3b6c4d8612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363a51d7b4494d40870356b269747c07" is_pre_election: true
I20260810 06:40:54.498818 5737 raft_consensus.cc:2454] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54e5889625e407694e3ac3b6c4d8612 in term 0.
I20260810 06:40:54.498839 6136 raft_consensus.cc:2454] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54e5889625e407694e3ac3b6c4d8612 in term 0.
I20260810 06:40:54.498994 5863 leader_election.cc:302] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6164767a5f34522a3dddbf1440d9a46, c54e5889625e407694e3ac3b6c4d8612; no voters:
I20260810 06:40:54.499123 6248 raft_consensus.cc:2781] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:40:54.499178 6248 raft_consensus.cc:482] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:40:54.499193 6248 raft_consensus.cc:3037] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:54.499963 6248 raft_consensus.cc:504] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:54.500110 6248 leader_election.cc:288] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [CANDIDATE]: Term 1 election: Requested vote from peers b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129:44331), 363a51d7b4494d40870356b269747c07 (127.27.41.131:40551)
I20260810 06:40:54.500308 6136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280929a1586343ee90683bce3c2c5a86" candidate_uuid: "c54e5889625e407694e3ac3b6c4d8612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363a51d7b4494d40870356b269747c07"
I20260810 06:40:54.500324 5737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280929a1586343ee90683bce3c2c5a86" candidate_uuid: "c54e5889625e407694e3ac3b6c4d8612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6164767a5f34522a3dddbf1440d9a46"
I20260810 06:40:54.500399 5737 raft_consensus.cc:3037] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:54.500399 6136 raft_consensus.cc:3037] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:54.501209 6136 raft_consensus.cc:2454] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54e5889625e407694e3ac3b6c4d8612 in term 1.
I20260810 06:40:54.501209 5737 raft_consensus.cc:2454] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54e5889625e407694e3ac3b6c4d8612 in term 1.
I20260810 06:40:54.501420 5858 leader_election.cc:302] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363a51d7b4494d40870356b269747c07, c54e5889625e407694e3ac3b6c4d8612; no voters:
I20260810 06:40:54.501533 6248 raft_consensus.cc:2781] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:54.501600 6248 raft_consensus.cc:686] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [term 1 LEADER]: Becoming Leader. State: Replica: c54e5889625e407694e3ac3b6c4d8612, State: Running, Role: LEADER
I20260810 06:40:54.501655 6248 consensus_queue.cc:237] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } }
I20260810 06:40:54.502349 5528 catalog_manager.cc:5495] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 reported cstate change: term changed from 0 to 1, leader changed from <none> to c54e5889625e407694e3ac3b6c4d8612 (127.27.41.130). New cstate: current_term: 1 leader_uuid: "c54e5889625e407694e3ac3b6c4d8612" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c54e5889625e407694e3ac3b6c4d8612" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 32789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 } health_report { overall_health: UNKNOWN } } }
I20260810 06:40:54.549808 6235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:54.547738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:37575 (local address 127.27.41.130:32789)
0810 06:40:54.547800 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:54.547803 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:54.547867 (+ 64us) server_negotiation.cc:407] Connection header received
0810 06:40:54.547923 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:54.547923 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:54.547932 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:54.547968 (+ 36us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:40:54.548058 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:54.548505 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:54.549196 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:54.549413 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:54.549489 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:54.549601 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:40:54.549624 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:40:54.549664 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:54.549712 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 06:40:54.549726 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":39}
I20260810 06:40:54.549817 6357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:54.547691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:32789 (local address 127.27.41.130:37575)
0810 06:40:54.547798 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:54.547810 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:54.547871 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:54.547969 (+ 98us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:54.547969 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:54.547971 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:40:54.548020 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:54.548022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:54.548564 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:54.548564 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:54.549101 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:54.549102 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:54.549498 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:54.549498 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:54.549545 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:54.549549 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:40:54.549665 (+ 116us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:40:54.549666 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 06:40:54.549692 (+ 26us) client_negotiation.cc:240] Negotiation successful
0810 06:40:54.549727 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":1,"thread_start_us":53,"threads_started":1}
I20260810 06:40:54.551780 5737 raft_consensus.cc:1261] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Refusing update from remote peer c54e5889625e407694e3ac3b6c4d8612: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:54.551805 6136 raft_consensus.cc:1261] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Refusing update from remote peer c54e5889625e407694e3ac3b6c4d8612: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:40:54.552034 6297 consensus_queue.cc:1035] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6164767a5f34522a3dddbf1440d9a46" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 44331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:54.552171 6311 consensus_queue.cc:1035] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363a51d7b4494d40870356b269747c07" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:40:54.561611 5528 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:54.561707 5528 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:40:54.562286 5528 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fbc58088d7494a89b04b584ab8200e9a: Sending DeleteTablet for 3 replicas of tablet 280929a1586343ee90683bce3c2c5a86
I20260810 06:40:54.562530 5926 tablet_service.cc:1514] Processing DeleteTablet for tablet 280929a1586343ee90683bce3c2c5a86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:54 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:56726
I20260810 06:40:54.562565 5729 tablet_service.cc:1514] Processing DeleteTablet for tablet 280929a1586343ee90683bce3c2c5a86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:54 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:43192
I20260810 06:40:54.562633 6109 tablet_service.cc:1514] Processing DeleteTablet for tablet 280929a1586343ee90683bce3c2c5a86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:40:54 UTC) from {username='oryx', principal='oryx/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:38036
I20260810 06:40:54.562664 6269 tablet_replica.cc:330] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46: stopping tablet replica
I20260810 06:40:54.562723 6270 tablet_replica.cc:330] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612: stopping tablet replica
I20260810 06:40:54.562727 6269 raft_consensus.cc:2229] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:54.562726 6271 tablet_replica.cc:330] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07: stopping tablet replica
I20260810 06:40:54.562767 6270 raft_consensus.cc:2229] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:40:54.562770 6269 raft_consensus.cc:2258] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:54.562790 6271 raft_consensus.cc:2229] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:40:54.562827 6271 raft_consensus.cc:2258] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:54.562815 6270 raft_consensus.cc:2258] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:40:54.563253 6269 ts_tablet_manager.cc:1905] T 280929a1586343ee90683bce3c2c5a86 P b6164767a5f34522a3dddbf1440d9a46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:54.563338 6270 ts_tablet_manager.cc:1905] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:54.563340 6271 ts_tablet_manager.cc:1905] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:40:54.564672 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 5637
I20260810 06:40:54.565233 6270 ts_tablet_manager.cc:1918] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:54.565287 6270 log.cc:1196] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/280929a1586343ee90683bce3c2c5a86
I20260810 06:40:54.565497 6270 ts_tablet_manager.cc:1939] T 280929a1586343ee90683bce3c2c5a86 P c54e5889625e407694e3ac3b6c4d8612: Deleting consensus metadata
I20260810 06:40:54.566921 6271 ts_tablet_manager.cc:1918] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:40:54.566965 6271 log.cc:1196] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/280929a1586343ee90683bce3c2c5a86
I20260810 06:40:54.567132 6271 ts_tablet_manager.cc:1939] T 280929a1586343ee90683bce3c2c5a86 P 363a51d7b4494d40870356b269747c07: Deleting consensus metadata
I20260810 06:40:54.567402 5511 catalog_manager.cc:4841] TS 363a51d7b4494d40870356b269747c07 (127.27.41.131:40551): tablet 280929a1586343ee90683bce3c2c5a86 (table test-table [id=4d1a62e1e3c34a1b85a38a288c60cdf1]) successfully deleted
I20260810 06:40:54.567858 5511 catalog_manager.cc:4841] TS c54e5889625e407694e3ac3b6c4d8612 (127.27.41.130:32789): tablet 280929a1586343ee90683bce3c2c5a86 (table test-table [id=4d1a62e1e3c34a1b85a38a288c60cdf1]) successfully deleted
W20260810 06:40:54.576956 5514 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:44331 (error 108)
I20260810 06:40:54.577316 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 5832
I20260810 06:40:54.577598 6363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:54.577379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:44331 (local address 127.0.0.1:43220)
0810 06:40:54.577478 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:54.577525 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:44331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80,"thread_start_us":80,"threads_started":1}
W20260810 06:40:54.582202 5514 catalog_manager.cc:4584] TS b6164767a5f34522a3dddbf1440d9a46 (127.27.41.129:44331): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 280929a1586343ee90683bce3c2c5a86: Network error: Client connection negotiation failed: client connection to 127.27.41.129:44331: connect: Connection refused (error 111)
I20260810 06:40:54.590601 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 6024
I20260810 06:40:54.602903 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 5489
2026-08-10T06:40:54Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3164 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:54 dist-test-slave-bw88 krb5kdc[6367](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:54 dist-test-slave-bw88 krb5kdc[6367](info): set up 2 sockets
Aug 10 06:40:54 dist-test-slave-bw88 krb5kdc[6367](info): commencing operation
krb5kdc: starting...
W20260810 06:40:55.810377 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:55 dist-test-slave-bw88 krb5kdc[6367](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:40:55.927973 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:42801
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:42801
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:56.009570 6385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:56.009788 6385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:56.009810 6385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:56.010905 6385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:56.010939 6385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:56.010953 6385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:56.010965 6385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:56.010977 6385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:56.012380 6385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:42801
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:42801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:56.012575 6385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:56.012745 6385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:56.017701 6392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:56.017709 6393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:56.017762 6395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:56.017913 6385 server_base.cc:1034] running on GCE node
I20260810 06:40:56.018150 6385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:56.018436 6385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:56.019594 6385 hybrid_clock.cc:648] HybridClock initialized: now 1786344056019572 us; error 37 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-10T06:40:56Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1418 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:40:56 dist-test-slave-bw88 krb5kdc[6403](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:40:56 dist-test-slave-bw88 krb5kdc[6403](info): set up 2 sockets
Aug 10 06:40:56 dist-test-slave-bw88 krb5kdc[6403](info): commencing operation
krb5kdc: starting...
W20260810 06:40:57.228022 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:40:57 dist-test-slave-bw88 krb5kdc[6403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:40:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:40:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:40:57.351643 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38191
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:38191
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:57.433230 6418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:57.433509 6418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:57.433538 6418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:57.434674 6418 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:57.434716 6418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:57.434731 6418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:57.434743 6418 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:57.434755 6418 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:57.436195 6418 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:38191
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:57.436467 6418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:57.436708 6418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:57.441730 6428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:57.441794 6425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:57.441758 6426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:57.441977 6418 server_base.cc:1034] running on GCE node
I20260810 06:40:57.442263 6418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:57.442548 6418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:57.443750 6418 hybrid_clock.cc:648] HybridClock initialized: now 1786344057443719 us; error 26 us; skew 500 ppm
Aug 10 06:40:57 dist-test-slave-bw88 krb5kdc[6403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344057, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:57.450917 6418 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:40:57.451381 6418 webserver.cc:460] Webserver started at http://127.27.41.190:35425/ using document root <none> and password file <none>
I20260810 06:40:57.451610 6418 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:57.451679 6418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:57.451850 6418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:57.452914 6418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "fb5231f735ed47559dee63ee4423c464"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "0daae870c1a2f99404b4ff290ae119df"
server_key_iv: "81e77f0ebe5a8ba608936f9607451f74"
server_key_version: "encryptionkey@0"
I20260810 06:40:57.453303 6418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "fb5231f735ed47559dee63ee4423c464"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "0daae870c1a2f99404b4ff290ae119df"
server_key_iv: "81e77f0ebe5a8ba608936f9607451f74"
server_key_version: "encryptionkey@0"
I20260810 06:40:57.454686 6418 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:57.455406 6436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:57.455580 6418 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:57.455693 6418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "fb5231f735ed47559dee63ee4423c464"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "0daae870c1a2f99404b4ff290ae119df"
server_key_iv: "81e77f0ebe5a8ba608936f9607451f74"
server_key_version: "encryptionkey@0"
I20260810 06:40:57.455775 6418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:57.488159 6418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:57.490551 6418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:57.490746 6418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:57.494835 6418 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:38191
I20260810 06:40:57.494872 6505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:38191 every 8 connection(s)
I20260810 06:40:57.495249 6418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:57.496110 6506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:40:57.496682 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 6418
I20260810 06:40:57.496815 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:40:57.497025 27814 external_mini_cluster.cc:1428] Setting key 2780c25aeb88d3be2e9ed50320cb33f5
I20260810 06:40:57.499126 6506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464: Bootstrap starting.
I20260810 06:40:57.499750 6506 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464: Neither blocks nor log segments found. Creating new log.
I20260810 06:40:57.500046 6506 log.cc:824] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:57.500852 6506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464: No bootstrap required, opened a new log
I20260810 06:40:57.503528 6506 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5231f735ed47559dee63ee4423c464" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38191 } }
I20260810 06:40:57.503669 6506 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:40:57.503690 6506 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb5231f735ed47559dee63ee4423c464, State: Initialized, Role: FOLLOWER
I20260810 06:40:57.503819 6506 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5231f735ed47559dee63ee4423c464" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38191 } }
I20260810 06:40:57.503896 6506 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
Aug 10 06:40:57 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:57.503938 6506 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:57.504024 6506 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:40:57.504556 6506 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5231f735ed47559dee63ee4423c464" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38191 } }
I20260810 06:40:57.504678 6506 leader_election.cc:302] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb5231f735ed47559dee63ee4423c464; no voters:
I20260810 06:40:57.504853 6506 leader_election.cc:288] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:40:57.504889 6512 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:40:57.505012 6512 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 1 LEADER]: Becoming Leader. State: Replica: fb5231f735ed47559dee63ee4423c464, State: Running, Role: LEADER
I20260810 06:40:57.505151 6506 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:57.505169 6512 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5231f735ed47559dee63ee4423c464" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38191 } }
I20260810 06:40:57.505576 6515 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb5231f735ed47559dee63ee4423c464. Latest consensus state: current_term: 1 leader_uuid: "fb5231f735ed47559dee63ee4423c464" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5231f735ed47559dee63ee4423c464" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38191 } } }
I20260810 06:40:57.505685 6515 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:57.505880 6514 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb5231f735ed47559dee63ee4423c464" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5231f735ed47559dee63ee4423c464" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38191 } } }
I20260810 06:40:57.505970 6514 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [sys.catalog]: This master's current role is: LEADER
W20260810 06:40:57.507125 6535 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:40:57.507186 6535 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:40:57.507243 6523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:57.507396 6523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:57.508329 6510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:57.497553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45608 (local address 127.27.41.190:38191)
0810 06:40:57.497731 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:57.497740 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:57.497774 (+ 34us) server_negotiation.cc:407] Connection header received
0810 06:40:57.498173 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:57.498180 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:57.498223 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:57.498329 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:57.499153 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:57.500147 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:57.501166 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:57.501611 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:57.501694 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:57.504386 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:57.504390 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:57.504390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:57.504402 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:57.506650 (+ 2248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:57.507058 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:57.507061 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:57.507062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:57.507158 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:57.507426 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:57.507428 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:57.507428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:57.507748 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:57.507886 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:57.507985 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 06:40:57.508123 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":98,"threads_started":1}
I20260810 06:40:57.509078 6523 catalog_manager.cc:1347] Generated new cluster ID: cb6a0870c9ad4c4fb18548a07c208d17
I20260810 06:40:57.509130 6523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:57.517017 6523 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:40:57.517603 6523 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:57.525682 6523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464: Generated new TSK 0
I20260810 06:40:57.525859 6523 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:40:57.564425 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38191
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:57.665853 6543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:57.666042 6543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:57.666064 6543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:57.667124 6543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:57.667157 6543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:57.667183 6543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:57.668512 6543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:57.668705 6543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:57.668900 6543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:57.674127 6552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:57.674122 6551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:57.674232 6543 server_base.cc:1034] running on GCE node
W20260810 06:40:57.674124 6554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:57.674516 6543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:57.674726 6543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:57.675863 6543 hybrid_clock.cc:648] HybridClock initialized: now 1786344057675843 us; error 36 us; skew 500 ppm
Aug 10 06:40:57 dist-test-slave-bw88 krb5kdc[6403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344057, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:57.678381 6543 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:40:57.678784 6543 webserver.cc:460] Webserver started at http://127.27.41.129:38261/ using document root <none> and password file <none>
I20260810 06:40:57.679000 6543 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:57.679051 6543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:57.679219 6543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:57.680214 6543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "9f2c5df2d50b4776a287768d1d6a8dcf"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "eea8062f3083059c47ba38b315440d0e"
server_key_iv: "fed9098335f8e57944bea33a98af6d80"
server_key_version: "encryptionkey@0"
I20260810 06:40:57.680573 6543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "9f2c5df2d50b4776a287768d1d6a8dcf"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "eea8062f3083059c47ba38b315440d0e"
server_key_iv: "fed9098335f8e57944bea33a98af6d80"
server_key_version: "encryptionkey@0"
I20260810 06:40:57.682060 6543 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:40:57.682776 6564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:57.682972 6543 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:40:57.683076 6543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "9f2c5df2d50b4776a287768d1d6a8dcf"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "eea8062f3083059c47ba38b315440d0e"
server_key_iv: "fed9098335f8e57944bea33a98af6d80"
server_key_version: "encryptionkey@0"
I20260810 06:40:57.683142 6543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:57.699690 6543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:57.701702 6543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:57.701884 6543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:57.702128 6543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:57.702469 6543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:57.702533 6543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:57.702580 6543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:57.702612 6543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:57.709260 6543 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:36595
I20260810 06:40:57.709313 6714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:36595 every 8 connection(s)
I20260810 06:40:57.709666 6543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:40:57.710683 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 6543
I20260810 06:40:57.710836 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:40:57.711069 27814 external_mini_cluster.cc:1428] Setting key c4822c051aa92fb66d9012993f6e2724
Aug 10 06:40:57 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344057, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
I20260810 06:40:57.719758 6510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:57.710364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:47385 (local address 127.27.41.190:38191)
0810 06:40:57.710436 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:57.710438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:57.710666 (+ 228us) server_negotiation.cc:407] Connection header received
0810 06:40:57.711379 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:57.711381 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:57.711403 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:57.711462 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:57.712438 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:57.712951 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:57.714149 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:57.714360 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:57.714474 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:57.716770 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:57.716772 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:57.716773 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:57.716781 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:57.718257 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:57.718713 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:57.718714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:57.718714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:57.718782 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:57.719064 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:57.719065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:57.719066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:57.719190 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:57.719278 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:57.719567 (+ 289us) server_negotiation.cc:299] Negotiation successful
0810 06:40:57.719662 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 06:40:57.719937 6718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:57.710344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:47385)
0810 06:40:57.710530 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:57.710569 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:57.711271 (+ 702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:57.711527 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:57.711531 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:57.712120 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:57.712317 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:57.712322 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:57.713073 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:57.713074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:57.714032 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:57.714035 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:57.714489 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:57.714490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:57.714697 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:57.715223 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:57.715232 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:57.716662 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:57.718364 (+ 1702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:57.718373 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:57.718375 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:57.718611 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:57.718858 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:57.718859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:57.718860 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:57.718987 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:57.719266 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:57.719274 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:57.719422 (+ 148us) client_negotiation.cc:769] Sending connection context
0810 06:40:57.719545 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 06:40:57.719699 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":104,"threads_started":1}
I20260810 06:40:57.720552 6715 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38191
I20260810 06:40:57.720643 6715 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:57.720794 6715 heartbeater.cc:511] Master 127.27.41.190:38191 requested a full tablet report, sending...
I20260810 06:40:57.721446 6460 ts_manager.cc:194] Registered new tserver with Master: 9f2c5df2d50b4776a287768d1d6a8dcf (127.27.41.129:36595)
I20260810 06:40:57.722200 6460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:47385
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:40:57.738127 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38191
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:57.820302 6721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:57.820533 6721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:57.820569 6721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:57.821754 6721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:57.821828 6721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:57.821874 6721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:57.823307 6721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:57.823557 6721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:57.823773 6721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:57.828861 6727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:57.828869 6726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:57.829015 6721 server_base.cc:1034] running on GCE node
W20260810 06:40:57.828869 6730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:57.829388 6721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:57.829596 6721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:57.830776 6721 hybrid_clock.cc:648] HybridClock initialized: now 1786344057830765 us; error 29 us; skew 500 ppm
Aug 10 06:40:57 dist-test-slave-bw88 krb5kdc[6403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344057, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:57.833395 6721 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:40:57.833834 6721 webserver.cc:460] Webserver started at http://127.27.41.130:38261/ using document root <none> and password file <none>
I20260810 06:40:57.834048 6721 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:57.834097 6721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:57.834245 6721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:57.835201 6721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "004c7b7d1a7c4f26a17170f9cc3f4267"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "4da0734e297e19e2240ab3165521fe1b"
server_key_iv: "3e5de72ab75898723d8f1fb865a17d82"
server_key_version: "encryptionkey@0"
I20260810 06:40:57.835551 6721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "004c7b7d1a7c4f26a17170f9cc3f4267"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "4da0734e297e19e2240ab3165521fe1b"
server_key_iv: "3e5de72ab75898723d8f1fb865a17d82"
server_key_version: "encryptionkey@0"
I20260810 06:40:57.836835 6721 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:40:57.837559 6739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:57.837747 6721 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:57.837841 6721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "004c7b7d1a7c4f26a17170f9cc3f4267"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "4da0734e297e19e2240ab3165521fe1b"
server_key_iv: "3e5de72ab75898723d8f1fb865a17d82"
server_key_version: "encryptionkey@0"
I20260810 06:40:57.837913 6721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:57.847647 6721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:57.849936 6721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:57.850099 6721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:57.850328 6721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:57.850630 6721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:57.850684 6721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:57.850704 6721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:57.850760 6721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:57.856895 6721 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:40207
I20260810 06:40:57.856945 6885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:40207 every 8 connection(s)
I20260810 06:40:57.857234 6721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
Aug 10 06:40:57 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344057, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:57.863246 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 6721
I20260810 06:40:57.863374 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:40:57.863580 27814 external_mini_cluster.cc:1428] Setting key 678a5964035433c80e20993c7f0bd431
I20260810 06:40:57.866688 6510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:57.858075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:40049 (local address 127.27.41.190:38191)
0810 06:40:57.858153 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:57.858155 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:57.858318 (+ 163us) server_negotiation.cc:407] Connection header received
0810 06:40:57.858864 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:57.858865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:57.858878 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:57.858936 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:57.859903 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:57.860396 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:57.861354 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:57.861546 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:57.861603 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:57.863725 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:57.863726 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:57.863726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:57.863734 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:57.865228 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:57.865680 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:57.865681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:57.865682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:57.865748 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:57.866013 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:57.866014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:57.866015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:57.866134 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:57.866229 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:57.866507 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 06:40:57.866600 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 06:40:57.866847 6889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:57.857997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:40049)
0810 06:40:57.858189 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:57.858231 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:57.858739 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:57.859009 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:57.859012 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:57.859613 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:57.859814 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:57.859819 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:57.860478 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:57.860479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:57.861262 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:57.861264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:57.861629 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:57.861630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:57.861733 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:57.862157 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:57.862165 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:57.863611 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:57.865356 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:57.865364 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:57.865366 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:57.865584 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:57.865830 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:57.865831 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:57.865831 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:57.865944 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:57.866204 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:57.866229 (+ 25us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:57.866365 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 06:40:57.866466 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 06:40:57.866622 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":85,"threads_started":1}
I20260810 06:40:57.867365 6886 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38191
I20260810 06:40:57.867455 6886 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:57.867627 6886 heartbeater.cc:511] Master 127.27.41.190:38191 requested a full tablet report, sending...
I20260810 06:40:57.868062 6460 ts_manager.cc:194] Registered new tserver with Master: 004c7b7d1a7c4f26a17170f9cc3f4267 (127.27.41.130:40207)
I20260810 06:40:57.868466 6460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:40049
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:40:57.890200 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38191
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:57.972645 6893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:57.972837 6893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:57.972862 6893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:57.974059 6893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:57.974102 6893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:57.974126 6893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:57.975605 6893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:57.975831 6893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:57.976066 6893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:57.981307 6903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:57.981312 6899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:57.981377 6900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:57.981703 6893 server_base.cc:1034] running on GCE node
I20260810 06:40:57.981947 6893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:57.982198 6893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:57.985399 6893 hybrid_clock.cc:648] HybridClock initialized: now 1786344057984923 us; error 487 us; skew 500 ppm
Aug 10 06:40:57 dist-test-slave-bw88 krb5kdc[6403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344057, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:57.987947 6893 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:40:57.988435 6893 webserver.cc:460] Webserver started at http://127.27.41.131:34199/ using document root <none> and password file <none>
I20260810 06:40:57.988669 6893 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:57.988740 6893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:57.988875 6893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:40:57.990015 6893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "97ef8e9efc024b058de01c0efc714e8f"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "744d0924e5d859e89c321635c9fff625"
server_key_iv: "fc77988a166ce38de3d2f8ecdcf6404a"
server_key_version: "encryptionkey@0"
I20260810 06:40:57.990404 6893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "97ef8e9efc024b058de01c0efc714e8f"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "744d0924e5d859e89c321635c9fff625"
server_key_iv: "fc77988a166ce38de3d2f8ecdcf6404a"
server_key_version: "encryptionkey@0"
I20260810 06:40:57.991756 6893 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:40:57.992554 6911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:57.992727 6893 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:57.992836 6893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "97ef8e9efc024b058de01c0efc714e8f"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "744d0924e5d859e89c321635c9fff625"
server_key_iv: "fc77988a166ce38de3d2f8ecdcf6404a"
server_key_version: "encryptionkey@0"
I20260810 06:40:57.992911 6893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:58.036013 6893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:58.038218 6893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:58.038390 6893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:58.038654 6893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:58.038985 6893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:58.039050 6893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.039113 6893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:58.039144 6893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.045480 6893 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:35125
I20260810 06:40:58.045562 7054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:35125 every 8 connection(s)
I20260810 06:40:58.045887 6893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344057, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:40:58.055100 6510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:58.046679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:42015 (local address 127.27.41.190:38191)
0810 06:40:58.046752 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:58.046754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:58.046969 (+ 215us) server_negotiation.cc:407] Connection header received
0810 06:40:58.047483 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:58.047484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:58.047493 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:58.047552 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:58.048506 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.048984 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.050056 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.050238 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.050291 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.052563 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:58.052564 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:58.052564 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:58.052570 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:58.053930 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:58.054318 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:58.054318 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:58.054319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:58.054369 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:58.054602 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:58.054603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:58.054603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:58.054698 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:58.054746 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:58.054967 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 06:40:58.055038 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 06:40:58.055267 7058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:58.046640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:42015)
0810 06:40:58.046817 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:58.046861 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:58.047397 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:58.047609 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:58.047612 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:58.048225 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:58.048426 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.048431 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.049068 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.049068 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.049974 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.049977 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.050319 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.050319 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.050445 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.050989 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:58.051004 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:58.052477 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:40:58.054021 (+ 1544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:58.054027 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:58.054029 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:58.054249 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:58.054445 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:40:58.054446 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:40:58.054446 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:40:58.054547 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:40:58.054753 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:40:58.054757 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:40:58.054864 (+ 107us) client_negotiation.cc:769] Sending connection context
0810 06:40:58.054944 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 06:40:58.055060 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":97,"threads_started":1}
I20260810 06:40:58.055692 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 6893
I20260810 06:40:58.055830 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:40:58.055871 7055 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38191
I20260810 06:40:58.055976 7055 heartbeater.cc:464] Registering TS with master...
I20260810 06:40:58.056051 27814 external_mini_cluster.cc:1428] Setting key 5e67230ecff273c2b6183c1fe3d5dc0f
I20260810 06:40:58.056182 7055 heartbeater.cc:511] Master 127.27.41.190:38191 requested a full tablet report, sending...
I20260810 06:40:58.056705 6460 ts_manager.cc:194] Registered new tserver with Master: 97ef8e9efc024b058de01c0efc714e8f (127.27.41.131:35125)
I20260810 06:40:58.057087 6460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:42015
I20260810 06:40:58.067961 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab.
Entry for principal oryx/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab.
WARNING: no policy specified for oryx/127.27.41.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab.
Entry for principal oryx/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab.
WARNING: no policy specified for oryx/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab.
Entry for principal oryx/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab.
I20260810 06:40:58.141989 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 6543
I20260810 06:40:58.150692 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 6721
I20260810 06:40:58.164937 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 6893
I20260810 06:40:58.173893 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 6418
I20260810 06:40:58.183189 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38191
--webserver_interface=127.27.41.190
--webserver_port=35425
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:38191
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:40:58.265740 7067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:58.265954 7067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:58.265978 7067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:58.267169 7067 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:40:58.267220 7067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:58.267235 7067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:58.267300 7067 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:40:58.267331 7067 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:40:58.268848 7067 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:38191
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=35425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:58.269124 7067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:58.269414 7067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:58.274765 7074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:58.274773 7078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:58.274775 7075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:58.274919 7067 server_base.cc:1034] running on GCE node
I20260810 06:40:58.275323 7067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:58.275692 7067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:58.276870 7067 hybrid_clock.cc:648] HybridClock initialized: now 1786344058276841 us; error 39 us; skew 500 ppm
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344058, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:58.279907 7067 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:40:58.280395 7067 webserver.cc:460] Webserver started at http://127.27.41.190:35425/ using document root <none> and password file <none>
I20260810 06:40:58.280613 7067 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:58.280674 7067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:58.282105 7067 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:58.282853 7089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.283043 7067 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:58.283140 7067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "fb5231f735ed47559dee63ee4423c464"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "0daae870c1a2f99404b4ff290ae119df"
server_key_iv: "81e77f0ebe5a8ba608936f9607451f74"
server_key_version: "encryptionkey@0"
I20260810 06:40:58.283489 7067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:58.306305 7067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:58.308272 7067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:58.308429 7067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:58.312353 7067 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:38191
I20260810 06:40:58.312391 7159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:38191 every 8 connection(s)
I20260810 06:40:58.312764 7067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:40:58.314404 7160 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:40:58.315075 7160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464: Bootstrap starting.
I20260810 06:40:58.318799 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 7067
I20260810 06:40:58.319176 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:36595
--local_ip_for_outbound_sockets=127.27.41.129
--tserver_master_addrs=127.27.41.190:38191
--webserver_port=38261
--webserver_interface=127.27.41.129
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.27.41.129
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:40:58.324836 7160 log.cc:824] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464: Log is configured to *not* fsync() on all Append() calls
I20260810 06:40:58.326568 7160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:40:58.326891 7160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464: Bootstrap complete.
I20260810 06:40:58.329226 7160 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5231f735ed47559dee63ee4423c464" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38191 } }
I20260810 06:40:58.329516 7160 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb5231f735ed47559dee63ee4423c464, State: Initialized, Role: FOLLOWER
I20260810 06:40:58.329691 7160 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5231f735ed47559dee63ee4423c464" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38191 } }
I20260810 06:40:58.329778 7160 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:40:58.329833 7160 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:40:58.329886 7160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 1 FOLLOWER]: Advancing to term 2
I20260810 06:40:58.330933 7160 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5231f735ed47559dee63ee4423c464" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38191 } }
I20260810 06:40:58.331058 7160 leader_election.cc:302] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb5231f735ed47559dee63ee4423c464; no voters:
I20260810 06:40:58.331269 7160 leader_election.cc:288] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 06:40:58.331303 7164 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 06:40:58.331424 7164 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [term 2 LEADER]: Becoming Leader. State: Replica: fb5231f735ed47559dee63ee4423c464, State: Running, Role: LEADER
I20260810 06:40:58.331552 7160 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:40:58.331583 7164 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5231f735ed47559dee63ee4423c464" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38191 } }
I20260810 06:40:58.331950 7165 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fb5231f735ed47559dee63ee4423c464" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5231f735ed47559dee63ee4423c464" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38191 } } }
I20260810 06:40:58.332036 7165 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:58.332381 7166 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb5231f735ed47559dee63ee4423c464. Latest consensus state: current_term: 2 leader_uuid: "fb5231f735ed47559dee63ee4423c464" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5231f735ed47559dee63ee4423c464" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38191 } } }
I20260810 06:40:58.332442 7171 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:40:58.333009 7171 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:40:58.333186 7171 catalog_manager.cc:1259] Loaded cluster ID: cb6a0870c9ad4c4fb18548a07c208d17
I20260810 06:40:58.333251 7171 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:40:58.333328 7166 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464 [sys.catalog]: This master's current role is: LEADER
I20260810 06:40:58.334271 7171 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:40:58.334395 7171 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fb5231f735ed47559dee63ee4423c464: Loaded TSK: 0
I20260810 06:40:58.334527 7171 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 06:40:58.421046 7162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:58.421291 7162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:58.421331 7162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:58.422477 7162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:58.422546 7162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:58.422591 7162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:40:58.424027 7162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.129.keytab
--principal=oryx/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:36595
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=38261
--tserver_master_addrs=127.27.41.190:38191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:58.424286 7162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:58.424526 7162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:58.429792 7193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:58.429908 7199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:58.429965 7162 server_base.cc:1034] running on GCE node
W20260810 06:40:58.430064 7190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:58.430279 7162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:58.430557 7162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:58.431730 7162 hybrid_clock.cc:648] HybridClock initialized: now 1786344058431715 us; error 30 us; skew 500 ppm
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344058, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:58.434705 7162 init.cc:377] Logged in from keytab as oryx/127.27.41.129@KRBTEST.COM (short username oryx)
I20260810 06:40:58.435158 7162 webserver.cc:460] Webserver started at http://127.27.41.129:38261/ using document root <none> and password file <none>
I20260810 06:40:58.435410 7162 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:58.435499 7162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:58.436820 7162 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:40:58.437577 7212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.437776 7162 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 06:40:58.437888 7162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "9f2c5df2d50b4776a287768d1d6a8dcf"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "eea8062f3083059c47ba38b315440d0e"
server_key_iv: "fed9098335f8e57944bea33a98af6d80"
server_key_version: "encryptionkey@0"
I20260810 06:40:58.438220 7162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:58.454031 7162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:58.456319 7162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:58.456533 7162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:58.456779 7162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:58.457077 7162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:58.457132 7162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.457171 7162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:58.457193 7162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.464133 7162 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:36595
I20260810 06:40:58.464179 7360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:36595 every 8 connection(s)
I20260810 06:40:58.464555 7162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:40:58.465467 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 7162
I20260810 06:40:58.465799 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:40207
--local_ip_for_outbound_sockets=127.27.41.130
--tserver_master_addrs=127.27.41.190:38191
--webserver_port=38261
--webserver_interface=127.27.41.130
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.27.41.130
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:40:58.474004 7363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:58.465408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:41581)
0810 06:40:58.465648 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:58.465685 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:58.466287 (+ 602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:58.466966 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:58.466971 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:58.467741 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:58.467950 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.467955 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.469108 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.469109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.469994 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.469996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.470722 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.470723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.470851 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.471388 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:58.471397 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:58.473795 (+ 2398us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":80,"threads_started":1}
W20260810 06:40:58.474314 7361 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:38191 (0 consecutive failures): Not authorized: Failed to ping master at 127.27.41.190:38191: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
W20260810 06:40:58.474438 7365 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:58.465566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:41581 (local address 127.27.41.190:38191)
0810 06:40:58.466508 (+ 942us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:58.466516 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:58.466564 (+ 48us) server_negotiation.cc:407] Connection header received
0810 06:40:58.466692 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:58.466698 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:58.466749 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:58.466876 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:58.468080 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.468995 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.470102 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.470617 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.470741 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.473915 (+ 3174us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:41581: BlockingRecv error: recv got EOF from 127.27.41.129:41581 (error 108)
Metrics: {"server-negotiator.queue_time_us":886,"thread_start_us":92,"threads_started":1}
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:40:58.478971 7363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:58.474574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:49187)
0810 06:40:58.474669 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:58.474680 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:58.474717 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:58.474878 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:58.474879 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:58.475016 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:58.475061 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.475063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.475693 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.475694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.476206 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.476208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.476581 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.476582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.476669 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.477116 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:58.477122 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:58.478885 (+ 1763us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":78}
W20260810 06:40:58.479035 7365 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:58.474690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:49187 (local address 127.27.41.190:38191)
0810 06:40:58.474725 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:58.474727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:58.474741 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:40:58.474761 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:58.474762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:58.474771 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:58.474858 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:58.475141 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.475609 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.476303 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.476496 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.476570 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.478969 (+ 2399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:49187: BlockingRecv error: recv got EOF from 127.27.41.129:49187 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:40:58.483872 7363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:58.479430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:46969)
0810 06:40:58.479509 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:58.479523 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:58.479576 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:58.479766 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:58.479767 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:58.479897 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:58.479926 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.479928 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.480662 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.480663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.481163 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.481165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.481625 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.481626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.481688 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.482134 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:58.482139 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:58.483790 (+ 1651us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":56}
W20260810 06:40:58.483924 7365 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:58.479595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:46969 (local address 127.27.41.190:38191)
0810 06:40:58.479649 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:58.479650 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:58.479657 (+ 7us) server_negotiation.cc:407] Connection header received
0810 06:40:58.479677 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:58.479678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:58.479692 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:58.479761 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:58.480010 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.480473 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.481255 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.481536 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.481623 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.483858 (+ 2235us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:46969: BlockingRecv error: recv got EOF from 127.27.41.129:46969 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260810 06:40:58.484186 7361 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:40:58.557195 7366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:58.557394 7366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:58.557418 7366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:58.558455 7366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:58.558490 7366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:58.558513 7366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:40:58.559826 7366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.130.keytab
--principal=oryx/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:40207
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=38261
--tserver_master_addrs=127.27.41.190:38191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:58.559994 7366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:58.560158 7366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:58.565271 7380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:58.565286 7373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:58.565282 7372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:58.565845 7366 server_base.cc:1034] running on GCE node
I20260810 06:40:58.566006 7366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:58.566210 7366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:58.567361 7366 hybrid_clock.cc:648] HybridClock initialized: now 1786344058567348 us; error 27 us; skew 500 ppm
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344058, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:58.573992 7366 init.cc:377] Logged in from keytab as oryx/127.27.41.130@KRBTEST.COM (short username oryx)
I20260810 06:40:58.574393 7366 webserver.cc:460] Webserver started at http://127.27.41.130:38261/ using document root <none> and password file <none>
I20260810 06:40:58.574590 7366 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:58.574642 7366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:58.575954 7366 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 06:40:58.576498 7393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.576676 7366 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.576777 7366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "004c7b7d1a7c4f26a17170f9cc3f4267"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "4da0734e297e19e2240ab3165521fe1b"
server_key_iv: "3e5de72ab75898723d8f1fb865a17d82"
server_key_version: "encryptionkey@0"
I20260810 06:40:58.577129 7366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:58.585042 7366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:58.587359 7366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:58.587527 7366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:58.587755 7366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:58.588043 7366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:58.588099 7366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.588140 7366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:58.588164 7366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.594319 7366 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:40207
I20260810 06:40:58.594372 7546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:40207 every 8 connection(s)
I20260810 06:40:58.594689 7366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 06:40:58.601586 7365 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:58.595331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:47913 (local address 127.27.41.190:38191)
0810 06:40:58.595390 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:58.595392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:58.595626 (+ 234us) server_negotiation.cc:407] Connection header received
0810 06:40:58.596124 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:58.596125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:58.596137 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:58.596191 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:58.597066 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.597607 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.598544 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.598718 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.598766 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.601540 (+ 2774us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:47913: BlockingRecv error: recv got EOF from 127.27.41.130:47913 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 06:40:58.601591 7552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:58.595309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:47913)
0810 06:40:58.595494 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:58.595536 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:58.596030 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:58.596259 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:58.596262 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:58.596810 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:58.596995 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.597000 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.597685 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.597686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.598464 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.598467 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.598788 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.598789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.598884 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.599363 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:58.599371 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:58.601454 (+ 2083us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
W20260810 06:40:58.601792 7547 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:38191 (0 consecutive failures): Not authorized: Failed to ping master at 127.27.41.190:38191: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
I20260810 06:40:58.602501 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 7366
I20260810 06:40:58.602793 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:35125
--local_ip_for_outbound_sockets=127.27.41.131
--tserver_master_addrs=127.27.41.190:38191
--webserver_port=34199
--webserver_interface=127.27.41.131
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.27.41.131
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:40:58.606727 7552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:58.602005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:51169)
0810 06:40:58.602121 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:58.602130 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:58.602169 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:58.602310 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:58.602310 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:58.602465 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:58.602519 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.602521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.603223 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.603224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.604031 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.604034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.604341 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.604342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.604414 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.604836 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:58.604840 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:58.606633 (+ 1793us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103}
W20260810 06:40:58.606751 7365 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:58.602077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:51169 (local address 127.27.41.190:38191)
0810 06:40:58.602128 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:58.602130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:58.602159 (+ 29us) server_negotiation.cc:407] Connection header received
0810 06:40:58.602216 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:58.602217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:58.602225 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:58.602271 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:58.602597 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.603136 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.604109 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.604271 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.604316 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.606711 (+ 2395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:51169: BlockingRecv error: recv got EOF from 127.27.41.130:51169 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:40:58.611197 7552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:58.607034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:51841)
0810 06:40:58.607085 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:58.607095 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:58.607174 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:58.607325 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:58.607326 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:58.607482 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:58.607511 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.607512 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.608123 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.608124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.608585 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.608587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.608918 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.608919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.608971 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.609416 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:58.609420 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:58.611126 (+ 1706us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 06:40:58.611245 7365 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:58.607120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:51841 (local address 127.27.41.190:38191)
0810 06:40:58.607200 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:58.607203 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:58.607213 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:40:58.607233 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:58.607234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:58.607254 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:58.607321 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:58.607586 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.608042 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.608670 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.608846 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.608918 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.611192 (+ 2274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:51841: BlockingRecv error: recv got EOF from 127.27.41.130:51841 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260810 06:40:58.611346 7547 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:40:58.686767 7553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:40:58.686985 7553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:40:58.687026 7553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:40:58.688161 7553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:40:58.688230 7553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:40:58.688274 7553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:40:58.689757 7553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/krb5kdc/oryx_127.27.41.131.keytab
--principal=oryx/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:35125
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=34199
--tserver_master_addrs=127.27.41.190:38191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:40:58.690001 7553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:40:58.690225 7553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:40:58.695304 7561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:58.695344 7553 server_base.cc:1034] running on GCE node
W20260810 06:40:58.695295 7563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:40:58.695293 7565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:40:58.695711 7553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:40:58.695958 7553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:40:58.697100 7553 hybrid_clock.cc:648] HybridClock initialized: now 1786344058697079 us; error 37 us; skew 500 ppm
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344058, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:40:58.699685 7553 init.cc:377] Logged in from keytab as oryx/127.27.41.131@KRBTEST.COM (short username oryx)
I20260810 06:40:58.700105 7553 webserver.cc:460] Webserver started at http://127.27.41.131:34199/ using document root <none> and password file <none>
I20260810 06:40:58.700330 7553 fs_manager.cc:359] Metadata directory not provided
I20260810 06:40:58.700409 7553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:40:58.701833 7553 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 06:40:58.702409 7574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.702597 7553 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.702687 7553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "97ef8e9efc024b058de01c0efc714e8f"
format_stamp: "Formatted at 2026-08-10 06:40:57 on dist-test-slave-bw88"
server_key: "744d0924e5d859e89c321635c9fff625"
server_key_iv: "fc77988a166ce38de3d2f8ecdcf6404a"
server_key_version: "encryptionkey@0"
I20260810 06:40:58.702973 7553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:40:58.710590 7553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:40:58.712291 7553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:40:58.712397 7553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:40:58.712560 7553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:40:58.712786 7553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:40:58.712816 7553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.712836 7553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:40:58.712848 7553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:40:58.718519 7553 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:35125
I20260810 06:40:58.718600 7719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:35125 every 8 connection(s)
I20260810 06:40:58.718940 7553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 06:40:58.725835 7365 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:58.719632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:38667 (local address 127.27.41.190:38191)
0810 06:40:58.719717 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:58.719720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:58.719903 (+ 183us) server_negotiation.cc:407] Connection header received
0810 06:40:58.720340 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:58.720341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:58.720352 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:58.720422 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:58.721283 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.721789 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.722722 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.722899 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.722949 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.725790 (+ 2841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:38667: BlockingRecv error: recv got EOF from 127.27.41.131:38667 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 06:40:58.725853 7722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:58.719610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:38667)
0810 06:40:58.719794 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:58.719827 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:58.720264 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:58.720487 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:58.720489 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:58.721020 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:58.721209 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.721214 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.721868 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.721869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.722649 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.722651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.722973 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.722974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.723094 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.723497 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:58.723504 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:58.725693 (+ 2189us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":106,"threads_started":1}
W20260810 06:40:58.726115 7720 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:38191 (0 consecutive failures): Not authorized: Failed to ping master at 127.27.41.190:38191: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
I20260810 06:40:58.729095 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 7553
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:40:58.730455 7722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:58.726362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:35143)
0810 06:40:58.726416 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:58.726428 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:58.726471 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:58.726734 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:58.726735 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:58.726841 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:58.726879 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.726880 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.727517 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.727518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.728024 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.728025 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.728364 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.728365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.728415 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.728754 (+ 339us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:58.728758 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:58.730416 (+ 1658us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 06:40:58.730568 7365 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:58.726571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:35143 (local address 127.27.41.190:38191)
0810 06:40:58.726626 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:58.726628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:58.726642 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:40:58.726661 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:58.726662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:58.726670 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:58.726715 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:58.726968 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.727449 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.728116 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.728293 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.728354 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.730513 (+ 2159us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:35143: BlockingRecv error: recv got EOF from 127.27.41.131:35143 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:58 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:40:58.735404 7722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:58.730694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:58031)
0810 06:40:58.730730 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:58.730739 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:58.730771 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:58.730953 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:58.730954 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:58.731084 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:58.731107 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.731108 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.731943 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.731944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.732616 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:58.732638 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.733110 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.733112 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:58.733167 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.733545 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:58.733549 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:58.735350 (+ 1801us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":23}
W20260810 06:40:58.735458 7365 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:58.730763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:58031 (local address 127.27.41.190:38191)
0810 06:40:58.730821 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:58.730823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:58.730830 (+ 7us) server_negotiation.cc:407] Connection header received
0810 06:40:58.730865 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:58.730865 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:58.730873 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:58.730949 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:58.731191 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.731865 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.732709 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.732990 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.733108 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.735421 (+ 2313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:58031: BlockingRecv error: recv got EOF from 127.27.41.131:58031 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260810 06:40:58.735642 7720 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 06:40:58.737485 7724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:58.729562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45610 (local address 127.27.41.190:38191)
0810 06:40:58.729678 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:58.729681 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:58.729776 (+ 95us) server_negotiation.cc:407] Connection header received
0810 06:40:58.729857 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:58.729858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:58.729869 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:58.729955 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:58.730666 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.731317 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.732337 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:58.732667 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:58.732729 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:58.734119 (+ 1390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:40:58.734123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:40:58.734124 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:40:58.734136 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:40:58.736039 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:58.736404 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:58.736407 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:58.736407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:58.736507 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:40:58.736732 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:40:58.736733 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:40:58.736733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:40:58.736980 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:40:58.737129 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 06:40:58.737251 (+ 122us) server_negotiation.cc:299] Negotiation successful
0810 06:40:58.737390 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":66,"threads_started":1}
Aug 10 06:40:59 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:59 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:40:59.489233 7725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:59.484597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:46141)
0810 06:40:59.484738 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:59.484748 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:59.484796 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:59.484925 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:59.484926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:59.485106 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:59.485177 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:59.485178 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:59.485934 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:59.485935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:59.486518 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:59.486519 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:59.486881 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:59.486882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:59.486922 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:59.487337 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:59.487342 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:59.489169 (+ 1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
W20260810 06:40:59.489403 7727 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:59.484654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:46141 (local address 127.27.41.190:38191)
0810 06:40:59.484791 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:59.484793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:59.484802 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:40:59.484846 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:59.484846 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:59.484856 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:59.484908 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:59.485246 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:59.485866 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:59.486594 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:59.486817 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:59.486870 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:59.489281 (+ 2411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:46141: BlockingRecv error: recv got EOF from 127.27.41.129:46141 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":80,"threads_started":1}
Aug 10 06:40:59 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:59 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:40:59.616467 7728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:59.611754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:46647)
0810 06:40:59.611927 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:59.611958 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:59.612037 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:59.612167 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:59.612168 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:59.612354 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:59.612438 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:59.612440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:59.613136 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:59.613136 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:59.613734 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:59.613736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:59.614062 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:59.614064 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:59.614108 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:59.614538 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:59.614543 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:59.616372 (+ 1829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":85,"threads_started":1}
W20260810 06:40:59.616516 7727 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:59.611892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:46647 (local address 127.27.41.190:38191)
0810 06:40:59.611962 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:59.611964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:59.612042 (+ 78us) server_negotiation.cc:407] Connection header received
0810 06:40:59.612090 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:59.612091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:59.612105 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:59.612153 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:59.612507 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:59.613030 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:59.613809 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:59.613991 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:59.614045 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:59.616469 (+ 2424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:46647: BlockingRecv error: recv got EOF from 127.27.41.130:46647 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 10 06:40:59 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:40:59 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:40:59.741000 7729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:40:59.736030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:52993)
0810 06:40:59.736229 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 06:40:59.736241 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:40:59.736334 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:40:59.736545 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:40:59.736546 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:40:59.736773 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:40:59.736838 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:59.736841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:59.737596 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:59.737597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:59.738149 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:40:59.738151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:40:59.738532 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:40:59.738533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:40:59.738592 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:59.739036 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:40:59.739040 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:40:59.740895 (+ 1855us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":108,"threads_started":1}
W20260810 06:40:59.741037 7727 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:40:59.736143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:52993 (local address 127.27.41.190:38191)
0810 06:40:59.736223 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 06:40:59.736225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:40:59.736313 (+ 88us) server_negotiation.cc:407] Connection header received
0810 06:40:59.736413 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:40:59.736414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:40:59.736429 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:40:59.736508 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:40:59.736905 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:59.737511 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:59.738242 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:40:59.738443 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:40:59.738530 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:40:59.740974 (+ 2444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:52993: BlockingRecv error: recv got EOF from 127.27.41.131:52993 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 10 06:41:00 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:00 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:00.494679 7730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:00.489868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:34971)
0810 06:41:00.490051 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:00.490062 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:00.490149 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:00.490345 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:00.490347 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:00.490602 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:00.490656 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:00.490658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:00.491328 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:00.491329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:00.491890 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:00.491891 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:00.492233 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:00.492233 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:00.492276 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:00.492730 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:00.492734 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:00.494620 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":115,"threads_started":1}
W20260810 06:41:00.494804 7731 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:00.489950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:34971 (local address 127.27.41.190:38191)
0810 06:41:00.490085 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:00.490087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:00.490128 (+ 41us) server_negotiation.cc:407] Connection header received
0810 06:41:00.490222 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:00.490223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:00.490245 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:00.490315 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:00.490732 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:00.491252 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:00.491966 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:00.492165 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:00.492216 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:00.494728 (+ 2512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:34971: BlockingRecv error: recv got EOF from 127.27.41.129:34971 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":73,"threads_started":1}
Aug 10 06:41:00 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:00 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:00.622408 7732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:00.617130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:50519)
0810 06:41:00.617331 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:00.617344 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:00.617444 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:00.617585 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:00.617586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:00.617807 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:00.617859 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:00.617861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:00.618558 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:00.618559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:00.619112 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:00.619113 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:00.619488 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:00.619489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:00.619555 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:00.620147 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:00.620154 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:00.622315 (+ 2161us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":103,"threads_started":1}
W20260810 06:41:00.622480 7731 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:00.617240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:50519 (local address 127.27.41.190:38191)
0810 06:41:00.617358 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:00.617361 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:00.617422 (+ 61us) server_negotiation.cc:407] Connection header received
0810 06:41:00.617501 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:00.617503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:00.617514 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:00.617574 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:00.617945 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:00.618464 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:00.619212 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:00.619413 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:00.619490 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:00.622414 (+ 2924us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:50519: BlockingRecv error: recv got EOF from 127.27.41.130:50519 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 10 06:41:00 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:00 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:00.746306 7733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:00.741589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:37055)
0810 06:41:00.741747 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:00.741762 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:00.741831 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:00.741976 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:00.741976 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:00.742179 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:00.742236 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:00.742238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:00.742960 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:00.742961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:00.743502 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:00.743504 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:00.743837 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:00.743838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:00.743882 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:00.744327 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:00.744331 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:00.746243 (+ 1912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":94,"threads_started":1}
W20260810 06:41:00.746381 7731 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:00.741731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:37055 (local address 127.27.41.190:38191)
0810 06:41:00.741796 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:00.741798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:00.741807 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:41:00.741904 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:00.741904 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:00.741917 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:00.741953 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:00.742301 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:00.742874 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:00.743584 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:00.743766 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:00.743818 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:00.746332 (+ 2514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:37055: BlockingRecv error: recv got EOF from 127.27.41.131:37055 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 10 06:41:01 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:01 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:01.500658 7734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:01.495230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:55795)
0810 06:41:01.495396 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:01.495408 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:01.495467 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:01.495642 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:01.495643 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:01.495814 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:01.495869 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:01.495871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:01.496803 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:01.496805 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:01.497740 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:01.497743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:01.498089 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:01.498090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:01.498129 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:01.498654 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:01.498660 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:01.500581 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":102,"threads_started":1}
W20260810 06:41:01.500728 7735 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:01.495348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:55795 (local address 127.27.41.190:38191)
0810 06:41:01.495519 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:01.495521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:01.495529 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:41:01.495553 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:01.495553 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:01.495563 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:01.495626 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:01.495961 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:01.496713 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:01.497814 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:01.498018 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:01.498081 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:01.500672 (+ 2591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:55795: BlockingRecv error: recv got EOF from 127.27.41.129:55795 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":115,"threads_started":1}
Aug 10 06:41:01 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:01 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:01.627641 7737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:01.622995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:53289)
0810 06:41:01.623162 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:01.623174 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:01.623240 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:01.623383 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:01.623384 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:01.623577 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:01.623629 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:01.623630 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:01.624303 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:01.624303 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:01.624843 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:01.624844 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:01.625190 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:01.625191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:01.625231 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:01.625767 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:01.625772 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:01.627569 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":110,"threads_started":1}
W20260810 06:41:01.627887 7735 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:01.623083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:53289 (local address 127.27.41.190:38191)
0810 06:41:01.623175 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:01.623177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:01.623246 (+ 69us) server_negotiation.cc:407] Connection header received
0810 06:41:01.623296 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:01.623296 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:01.623309 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:01.623354 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:01.623707 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:01.624228 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:01.624920 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:01.625119 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:01.625175 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:01.627758 (+ 2583us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:53289: BlockingRecv error: recv got EOF from 127.27.41.130:53289 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 10 06:41:01 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:01 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:01.751737 7738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:01.746893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:59891)
0810 06:41:01.747029 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:01.747046 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:01.747110 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:01.747278 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:01.747279 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:01.747470 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:01.747525 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:01.747527 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:01.748183 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:01.748184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:01.748826 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:01.748828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:01.749224 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:01.749225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:01.749293 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:01.749793 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:01.749797 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:01.751624 (+ 1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":59,"threads_started":1}
W20260810 06:41:01.751793 7735 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:01.746980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:59891 (local address 127.27.41.190:38191)
0810 06:41:01.747083 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:01.747085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:01.747097 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:41:01.747182 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:01.747183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:01.747197 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:01.747249 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:01.747600 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:01.748108 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:01.748923 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:01.749126 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:01.749221 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:01.751722 (+ 2501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:59891: BlockingRecv error: recv got EOF from 127.27.41.131:59891 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 10 06:41:02 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:02 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:02.511472 7741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:02.501250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:55293)
0810 06:41:02.501446 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:02.501457 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:02.501517 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:02.501663 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:02.501664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:02.501834 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:02.501885 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:02.501886 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:02.502535 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:02.502536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:02.503065 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:02.503067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:02.503400 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:02.503401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:02.503443 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:02.509604 (+ 6161us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:02.509610 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:02.511410 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":68,"threads_started":1}
W20260810 06:41:02.511595 7742 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:02.501304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:55293 (local address 127.27.41.190:38191)
0810 06:41:02.501466 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:02.501468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:02.501512 (+ 44us) server_negotiation.cc:407] Connection header received
0810 06:41:02.501568 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:02.501568 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:02.501578 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:02.501642 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:02.501947 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:02.502469 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:02.503135 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:02.503333 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:02.503386 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:02.511517 (+ 8131us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:55293: BlockingRecv error: recv got EOF from 127.27.41.129:55293 (error 108)
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":105,"threads_started":1}
Aug 10 06:41:02 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:02 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:02.632925 7744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:02.628161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:53589)
0810 06:41:02.628368 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:02.628381 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:02.628473 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:02.628612 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:02.628612 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:02.628813 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:02.628864 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:02.628865 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:02.629554 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:02.629554 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:02.630062 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:02.630063 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:02.630388 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:02.630389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:02.630428 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:02.630940 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:02.630945 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:02.632850 (+ 1905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":80,"threads_started":1}
W20260810 06:41:02.633091 7742 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:02.628343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:53589 (local address 127.27.41.190:38191)
0810 06:41:02.628409 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:02.628411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:02.628455 (+ 44us) server_negotiation.cc:407] Connection header received
0810 06:41:02.628530 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:02.628531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:02.628546 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:02.628585 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:02.628942 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:02.629476 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:02.630128 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:02.630323 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:02.630377 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:02.633021 (+ 2644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:53589: BlockingRecv error: recv got EOF from 127.27.41.130:53589 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 10 06:41:02 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:02 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:02.757401 7745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:02.752285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:43427)
0810 06:41:02.752520 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:02.752542 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:02.752637 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:02.752818 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:02.752819 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:02.753010 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:02.753064 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:02.753066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:02.753829 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:02.753830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:02.754385 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:02.754386 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:02.754816 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:02.754818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:02.754887 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:02.755435 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:02.755441 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:02.757289 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":156,"threads_started":1}
W20260810 06:41:02.757452 7742 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:02.752445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:43427 (local address 127.27.41.190:38191)
0810 06:41:02.752525 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:02.752528 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:02.752614 (+ 86us) server_negotiation.cc:407] Connection header received
0810 06:41:02.752723 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:02.752724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:02.752738 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:02.752807 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:02.753150 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:02.753745 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:02.754501 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:02.754733 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:02.754816 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:02.757389 (+ 2573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:43427: BlockingRecv error: recv got EOF from 127.27.41.131:43427 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 10 06:41:03 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:03 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:03.517144 7746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:03.512227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:55485)
0810 06:41:03.512357 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:03.512369 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:03.512471 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:03.512637 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:03.512638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:03.512844 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:03.512897 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:03.512899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:03.513773 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:03.513774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:03.514302 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:03.514303 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:03.514764 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:03.514766 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:03.514825 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:03.515352 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:03.515357 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:03.517086 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":71,"threads_started":1}
W20260810 06:41:03.517257 7747 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:03.512300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:55485 (local address 127.27.41.190:38191)
0810 06:41:03.512509 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:03.512511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:03.512518 (+ 7us) server_negotiation.cc:407] Connection header received
0810 06:41:03.512541 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:03.512541 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:03.512552 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:03.512622 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:03.512984 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:03.513687 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:03.514373 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:03.514669 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:03.514754 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:03.517178 (+ 2424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:55485: BlockingRecv error: recv got EOF from 127.27.41.129:55485 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":115,"threads_started":1}
Aug 10 06:41:03 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:03 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:03.638263 7748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:03.633421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:40303)
0810 06:41:03.633572 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:03.633587 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:03.633637 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:03.633771 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:03.633771 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:03.633936 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:03.633988 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:03.633989 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:03.634870 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:03.634871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:03.635463 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:03.635465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:03.635866 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:03.635867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:03.635921 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:03.636416 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:03.636420 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:03.638201 (+ 1781us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
W20260810 06:41:03.638479 7747 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:03.633558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:40303 (local address 127.27.41.190:38191)
0810 06:41:03.633628 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:03.633630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:03.633639 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:41:03.633700 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:03.633701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:03.633711 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:03.633754 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:03.634055 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:03.634777 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:03.635568 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:03.635788 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:03.635860 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:03.638329 (+ 2469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:40303: BlockingRecv error: recv got EOF from 127.27.41.130:40303 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 10 06:41:03 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:03 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:03.763093 7749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:03.757933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:59679)
0810 06:41:03.758090 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:03.758105 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:03.758161 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:03.758296 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:03.758297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:03.758469 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:03.758521 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:03.758522 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:03.759424 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:03.759425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:03.759985 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:03.759987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:03.760365 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:03.760366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:03.760409 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:03.760893 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:03.760897 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:03.763027 (+ 2130us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":86,"threads_started":1}
W20260810 06:41:03.763219 7747 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:03.758021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:59679 (local address 127.27.41.190:38191)
0810 06:41:03.758091 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:03.758093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:03.758163 (+ 70us) server_negotiation.cc:407] Connection header received
0810 06:41:03.758205 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:03.758205 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:03.758218 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:03.758277 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:03.758721 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:03.759338 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:03.760076 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:03.760288 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:03.760359 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:03.763119 (+ 2760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:59679: BlockingRecv error: recv got EOF from 127.27.41.131:59679 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 10 06:41:04 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:04 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:04.522924 7751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:04.517671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:56043)
0810 06:41:04.517832 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:04.517844 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:04.517914 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:04.518079 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:04.518080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:04.518317 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:04.518369 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:04.518372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:04.519258 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:04.519259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:04.519901 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:04.519903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:04.520316 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:04.520317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:04.520378 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:04.520912 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:04.520918 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:04.522865 (+ 1947us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":92,"threads_started":1}
W20260810 06:41:04.523078 7753 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:04.517716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:56043 (local address 127.27.41.190:38191)
0810 06:41:04.517840 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:04.517842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:04.517896 (+ 54us) server_negotiation.cc:407] Connection header received
0810 06:41:04.517957 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:04.517957 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:04.517968 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:04.518054 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:04.518466 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:04.519175 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:04.520020 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:04.520232 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:04.520303 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:04.522988 (+ 2685us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:56043: BlockingRecv error: recv got EOF from 127.27.41.129:56043 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
Aug 10 06:41:04 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:04 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:04.643666 7754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:04.638815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:39989)
0810 06:41:04.638999 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:04.639010 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:04.639071 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:04.639189 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:04.639190 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:04.639353 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:04.639405 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:04.639407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:04.640064 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:04.640064 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:04.640657 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:04.640659 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:04.640985 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:04.640986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:04.641025 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:04.641674 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:04.641682 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:04.643607 (+ 1925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":128,"threads_started":1}
W20260810 06:41:04.643775 7753 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:04.638875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:39989 (local address 127.27.41.190:38191)
0810 06:41:04.638963 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:04.638966 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:04.639069 (+ 103us) server_negotiation.cc:407] Connection header received
0810 06:41:04.639117 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:04.639118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:04.639129 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:04.639181 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:04.639462 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:04.639994 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:04.640729 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:04.640919 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:04.640974 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:04.643709 (+ 2735us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:39989: BlockingRecv error: recv got EOF from 127.27.41.130:39989 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 10 06:41:04 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:04 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:04.768287 7755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:04.763570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:44373)
0810 06:41:04.763755 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:04.763765 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:04.763821 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:04.763960 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:04.763960 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:04.764129 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:04.764181 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:04.764183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:04.764804 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:04.764805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:04.765327 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:04.765329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:04.765695 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:04.765696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:04.765738 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:04.766167 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:04.766172 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:04.768191 (+ 2019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":124,"threads_started":1}
W20260810 06:41:04.768332 7753 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:04.763704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:44373 (local address 127.27.41.190:38191)
0810 06:41:04.763772 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:04.763774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:04.763810 (+ 36us) server_negotiation.cc:407] Connection header received
0810 06:41:04.763866 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:04.763867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:04.763879 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:04.763934 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:04.764246 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:04.764739 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:04.765452 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:04.765630 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:04.765678 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:04.768269 (+ 2591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:44373: BlockingRecv error: recv got EOF from 127.27.41.131:44373 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 10 06:41:05 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:05 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:05.528093 7757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:05.523380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:35279)
0810 06:41:05.523504 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:05.523514 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:05.523581 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:05.523708 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:05.523708 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:05.523882 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:05.523951 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:05.523952 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:05.524605 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:05.524606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:05.525144 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:05.525145 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:05.525524 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:05.525525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:05.525575 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:05.526012 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:05.526017 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:05.528026 (+ 2009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":70,"threads_started":1}
W20260810 06:41:05.528258 7758 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:05.523429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:35279 (local address 127.27.41.190:38191)
0810 06:41:05.523592 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:05.523594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:05.523602 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:41:05.523625 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:05.523625 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:05.523636 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:05.523702 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:05.524019 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:05.524528 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:05.525216 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:05.525456 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:05.525510 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:05.528169 (+ 2659us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:35279: BlockingRecv error: recv got EOF from 127.27.41.129:35279 (error 108)
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":103,"threads_started":1}
Aug 10 06:41:05 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:05 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:05.649317 7760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:05.644180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:40677)
0810 06:41:05.644334 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:05.644352 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:05.644437 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:05.644607 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:05.644608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:05.644798 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:05.644853 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:05.644856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:05.645613 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:05.645615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:05.646150 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:05.646152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:05.646525 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:05.646526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:05.646599 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:05.647062 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:05.647067 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:05.649257 (+ 2190us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":74,"threads_started":1}
W20260810 06:41:05.649492 7758 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:05.644256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:40677 (local address 127.27.41.190:38191)
0810 06:41:05.644316 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:05.644323 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:05.644423 (+ 100us) server_negotiation.cc:407] Connection header received
0810 06:41:05.644510 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:05.644511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:05.644525 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:05.644597 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:05.644941 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:05.645516 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:05.646251 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:05.646450 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:05.646527 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:05.649411 (+ 2884us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:40677: BlockingRecv error: recv got EOF from 127.27.41.130:40677 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 10 06:41:05 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:05 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:05.773824 7761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:05.768758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:41251)
0810 06:41:05.768952 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:05.768966 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:05.769065 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:05.769227 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:05.769229 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:05.769476 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:05.769535 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:05.769538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:05.770159 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:05.770160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:05.770690 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:05.770691 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:05.771022 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:05.771023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:05.771063 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:05.771589 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:05.771594 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:05.773724 (+ 2130us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":89,"threads_started":1}
W20260810 06:41:05.773880 7758 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:05.768872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:41251 (local address 127.27.41.190:38191)
0810 06:41:05.768917 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:05.768919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:05.769056 (+ 137us) server_negotiation.cc:407] Connection header received
0810 06:41:05.769110 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:05.769110 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:05.769123 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:05.769170 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:05.769610 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:05.770084 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:05.770773 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:05.770951 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:05.771006 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:05.773802 (+ 2796us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:41251: BlockingRecv error: recv got EOF from 127.27.41.131:41251 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 10 06:41:06 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:06 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:06.533702 7762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:06.528601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:51163)
0810 06:41:06.528755 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:06.528767 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:06.528832 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:06.528981 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:06.528981 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:06.529164 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:06.529222 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:06.529224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:06.529954 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:06.529955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:06.530509 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:06.530511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:06.530852 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:06.530853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:06.530903 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:06.531482 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:06.531493 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:06.533603 (+ 2110us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
W20260810 06:41:06.533759 7763 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:06.528707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:51163 (local address 127.27.41.190:38191)
0810 06:41:06.528846 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:06.528852 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:06.528861 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:41:06.528882 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:06.528883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:06.528893 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:06.528957 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:06.529294 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:06.529867 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:06.530585 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:06.530782 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:06.530833 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:06.533684 (+ 2851us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:51163: BlockingRecv error: recv got EOF from 127.27.41.129:51163 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":85,"threads_started":1}
Aug 10 06:41:06 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:06 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:06.654388 7765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:06.649842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:50639)
0810 06:41:06.650028 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:06.650041 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:06.650119 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:06.650272 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:06.650273 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:06.650439 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:06.650493 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:06.650494 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:06.651227 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:06.651228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:06.651756 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:06.651757 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:06.652101 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:06.652101 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:06.652142 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:06.652604 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:06.652609 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:06.654329 (+ 1720us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":80,"threads_started":1}
W20260810 06:41:06.654541 7763 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:06.650000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:50639 (local address 127.27.41.190:38191)
0810 06:41:06.650064 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:06.650066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:06.650093 (+ 27us) server_negotiation.cc:407] Connection header received
0810 06:41:06.650174 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:06.650175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:06.650186 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:06.650234 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:06.650548 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:06.651163 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:06.651823 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:06.652034 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:06.652087 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:06.654457 (+ 2370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:50639: BlockingRecv error: recv got EOF from 127.27.41.130:50639 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 10 06:41:06 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:06 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:06.779213 7767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:06.774374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:53829)
0810 06:41:06.774571 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:06.774585 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:06.774660 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:06.774816 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:06.774818 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:06.775002 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:06.775053 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:06.775055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:06.775744 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:06.775745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:06.776569 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:06.776572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:06.776905 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:06.776905 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:06.776949 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:06.777395 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:06.777400 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:06.779153 (+ 1753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":111,"threads_started":1}
W20260810 06:41:06.779397 7763 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:06.774450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:53829 (local address 127.27.41.190:38191)
0810 06:41:06.774521 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:06.774523 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:06.774640 (+ 117us) server_negotiation.cc:407] Connection header received
0810 06:41:06.774721 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:06.774722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:06.774736 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:06.774808 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:06.775133 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:06.775632 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:06.776642 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:06.776837 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:06.776896 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:06.779283 (+ 2387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:53829: BlockingRecv error: recv got EOF from 127.27.41.131:53829 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 10 06:41:07 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:07 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:07.543076 7769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:07.534246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:48929)
0810 06:41:07.534409 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:07.534438 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:07.534502 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:07.534632 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:07.534633 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:07.534804 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:07.534857 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:07.534858 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:07.535500 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:07.535501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:07.536059 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:07.536060 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:07.536493 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:07.536494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:07.536536 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:07.540926 (+ 4390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:07.540930 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:07.542964 (+ 2034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":82,"threads_started":1}
W20260810 06:41:07.543128 7771 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:07.534306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:48929 (local address 127.27.41.190:38191)
0810 06:41:07.534431 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:07.534433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:07.534497 (+ 64us) server_negotiation.cc:407] Connection header received
0810 06:41:07.534553 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:07.534554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:07.534564 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:07.534623 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:07.534914 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:07.535432 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:07.536180 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:07.536410 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:07.536487 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:07.543053 (+ 6566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:48929: BlockingRecv error: recv got EOF from 127.27.41.129:48929 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":72,"threads_started":1}
Aug 10 06:41:07 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:07 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:07.659875 7772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:07.654876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:55921)
0810 06:41:07.655029 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:07.655039 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:07.655086 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:07.655362 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:07.655362 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:07.655543 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:07.655597 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:07.655598 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:07.656222 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:07.656223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:07.656769 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:07.656771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:07.657138 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:07.657140 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:07.657194 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:07.657671 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:07.657676 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:07.659781 (+ 2105us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":69,"threads_started":1}
W20260810 06:41:07.659933 7771 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:07.655041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:55921 (local address 127.27.41.190:38191)
0810 06:41:07.655220 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:07.655222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:07.655230 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:41:07.655255 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:07.655256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:07.655266 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:07.655336 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:07.655671 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:07.656154 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:07.656844 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:07.657015 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:07.657070 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:07.659888 (+ 2818us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:55921: BlockingRecv error: recv got EOF from 127.27.41.130:55921 (error 108)
Metrics: {"server-negotiator.queue_time_us":150}
Aug 10 06:41:07 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:07 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:07.784888 7773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:07.779715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:50457)
0810 06:41:07.779900 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:07.779914 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:07.780003 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:07.780188 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:07.780189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:07.780466 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:07.780540 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:07.780542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:07.781264 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:07.781265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:07.781850 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:07.781852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:07.782270 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:07.782271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:07.782362 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:07.782851 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:07.782859 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:07.784776 (+ 1917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":93,"threads_started":1}
W20260810 06:41:07.784924 7771 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:07.779811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:50457 (local address 127.27.41.190:38191)
0810 06:41:07.779894 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:07.779897 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:07.779974 (+ 77us) server_negotiation.cc:407] Connection header received
0810 06:41:07.780074 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:07.780075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:07.780097 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:07.780165 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:07.780651 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:07.781163 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:07.781954 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:07.782181 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:07.782269 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:07.784858 (+ 2589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:50457: BlockingRecv error: recv got EOF from 127.27.41.131:50457 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 10 06:41:08 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:08 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:08.548446 7774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:08.543537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:41279)
0810 06:41:08.543714 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:08.543725 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:08.543791 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:08.543919 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:08.543919 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:08.544140 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:08.544194 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:08.544196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:08.544872 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:08.544874 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:08.545581 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:08.545584 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:08.545949 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:08.545950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:08.546005 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:08.546459 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:08.546464 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:08.548351 (+ 1887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":94,"threads_started":1}
W20260810 06:41:08.548511 7776 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:08.543613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:41279 (local address 127.27.41.190:38191)
0810 06:41:08.543715 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:08.543719 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:08.543791 (+ 72us) server_negotiation.cc:407] Connection header received
0810 06:41:08.543843 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:08.543844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:08.543854 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:08.543907 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:08.544256 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:08.544768 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:08.545660 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:08.545861 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:08.545916 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:08.548436 (+ 2520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:41279: BlockingRecv error: recv got EOF from 127.27.41.129:41279 (error 108)
Metrics: {"server-negotiator.queue_time_us":78,"thread_start_us":49,"threads_started":1}
Aug 10 06:41:08 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:08 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:08.665020 7777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:08.660395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:50913)
0810 06:41:08.660545 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:08.660556 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:08.660616 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:08.660754 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:08.660755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:08.660933 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:08.660986 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:08.660988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:08.661657 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:08.661658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:08.662184 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:08.662185 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:08.662521 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:08.662522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:08.662562 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:08.663039 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:08.663043 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:08.664959 (+ 1916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":99,"threads_started":1}
W20260810 06:41:08.665186 7776 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:08.660486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:50913 (local address 127.27.41.190:38191)
0810 06:41:08.660551 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:08.660554 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:08.660622 (+ 68us) server_negotiation.cc:407] Connection header received
0810 06:41:08.660669 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:08.660670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:08.660681 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:08.660732 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:08.661060 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:08.661585 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:08.662261 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:08.662456 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:08.662505 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:08.665094 (+ 2589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:50913: BlockingRecv error: recv got EOF from 127.27.41.130:50913 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 10 06:41:08 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:08 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:08.790490 7778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:08.785488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:41949)
0810 06:41:08.785705 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:08.785717 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:08.785785 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:08.785933 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:08.785934 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:08.786135 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:08.786194 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:08.786196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:08.786885 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:08.786894 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:08.787498 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:08.787501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:08.787899 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:08.787900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:08.787964 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:08.788593 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:08.788599 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:08.790413 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":126,"threads_started":1}
W20260810 06:41:08.790567 7776 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:08.785643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:41949 (local address 127.27.41.190:38191)
0810 06:41:08.785695 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:08.785697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:08.785785 (+ 88us) server_negotiation.cc:407] Connection header received
0810 06:41:08.785841 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:08.785842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:08.785853 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:08.785903 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:08.786257 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:08.786805 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:08.787573 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:08.787796 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:08.787870 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:08.790505 (+ 2635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:41949: BlockingRecv error: recv got EOF from 127.27.41.131:41949 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 10 06:41:09 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:09 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:09.553717 7779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:09.548930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:51301)
0810 06:41:09.549114 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:09.549127 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:09.549190 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:09.549326 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:09.549326 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:09.549564 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:09.549616 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:09.549619 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:09.550330 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:09.550331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:09.550864 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:09.550866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:09.551255 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:09.551256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:09.551310 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:09.551756 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:09.551761 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:09.553645 (+ 1884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":92,"threads_started":1}
W20260810 06:41:09.553865 7780 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:09.548996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:51301 (local address 127.27.41.190:38191)
0810 06:41:09.549173 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:09.549175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:09.549184 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:41:09.549236 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:09.549237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:09.549247 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:09.549307 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:09.549730 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:09.550253 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:09.550951 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:09.551158 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:09.551223 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:09.553747 (+ 2524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:51301: BlockingRecv error: recv got EOF from 127.27.41.129:51301 (error 108)
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":107,"threads_started":1}
Aug 10 06:41:09 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:09 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:09.670756 7781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:09.665700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:40401)
0810 06:41:09.665891 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:09.665903 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:09.665960 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:09.666089 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:09.666090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:09.666268 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:09.666320 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:09.666321 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:09.667078 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:09.667079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:09.667809 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:09.667812 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:09.668198 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:09.668200 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:09.668253 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:09.668756 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:09.668761 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:09.670648 (+ 1887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":125,"threads_started":1}
W20260810 06:41:09.670799 7780 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:09.665797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:40401 (local address 127.27.41.190:38191)
0810 06:41:09.665866 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:09.665870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:09.665962 (+ 92us) server_negotiation.cc:407] Connection header received
0810 06:41:09.666011 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:09.666012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:09.666025 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:09.666086 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:09.666420 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:09.666957 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:09.667884 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:09.668118 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:09.668201 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:09.670733 (+ 2532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:40401: BlockingRecv error: recv got EOF from 127.27.41.130:40401 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 10 06:41:09 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:09 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:09.795701 7784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:09.791040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:49355)
0810 06:41:09.791230 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:09.791240 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:09.791301 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:09.791435 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:09.791436 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:09.791652 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:09.791708 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:09.791710 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:09.792345 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:09.792346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:09.792900 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:09.792901 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:09.793236 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:09.793237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:09.793278 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:09.793854 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:09.793859 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:09.795630 (+ 1771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":121,"threads_started":1}
W20260810 06:41:09.795773 7780 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:09.791101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:49355 (local address 127.27.41.190:38191)
0810 06:41:09.791172 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:09.791179 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:09.791302 (+ 123us) server_negotiation.cc:407] Connection header received
0810 06:41:09.791346 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:09.791347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:09.791359 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:09.791410 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:09.791777 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:09.792271 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:09.792980 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:09.793165 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:09.793216 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:09.795724 (+ 2508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:49355: BlockingRecv error: recv got EOF from 127.27.41.131:49355 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 10 06:41:10 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:10 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:10.559231 7785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:10.554205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:40591)
0810 06:41:10.554375 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:10.554386 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:10.554446 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:10.554593 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:10.554594 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:10.554774 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:10.554839 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:10.554841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:10.555568 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:10.555569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:10.556150 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:10.556152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:10.556554 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:10.556555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:10.556598 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:10.557148 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:10.557153 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:10.559132 (+ 1979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":95,"threads_started":1}
W20260810 06:41:10.559288 7786 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:10.554303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:40591 (local address 127.27.41.190:38191)
0810 06:41:10.554422 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:10.554424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:10.554433 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:41:10.554507 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:10.554508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:10.554519 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:10.554570 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:10.554954 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:10.555481 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:10.556245 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:10.556481 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:10.556540 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:10.559215 (+ 2675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:40591: BlockingRecv error: recv got EOF from 127.27.41.129:40591 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
Aug 10 06:41:10 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:10 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:10.676448 7787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:10.671307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:58665)
0810 06:41:10.671522 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:10.671533 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:10.671592 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:10.671746 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:10.671747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:10.671919 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:10.672028 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:10.672030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:10.672957 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:10.672964 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:10.673558 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:10.673560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:10.673902 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:10.673903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:10.673945 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:10.674471 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:10.674476 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:10.676368 (+ 1892us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":119,"threads_started":1}
W20260810 06:41:10.676539 7786 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:10.671480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:58665 (local address 127.27.41.190:38191)
0810 06:41:10.671568 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:10.671570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:10.671580 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:41:10.671659 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:10.671659 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:10.671673 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:10.671724 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:10.672140 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:10.672874 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:10.673637 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:10.673829 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:10.673898 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:10.676453 (+ 2555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:58665: BlockingRecv error: recv got EOF from 127.27.41.130:58665 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 10 06:41:10 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:10 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:10.801486 7788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:10.796269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:47567)
0810 06:41:10.796546 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:10.796577 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:10.796649 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:10.796793 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:10.796794 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:10.796980 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:10.797034 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:10.797036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:10.797786 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:10.797787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:10.798322 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:10.798324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:10.798788 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:10.798789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:10.798836 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:10.799322 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:10.799326 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:10.801321 (+ 1995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":87,"threads_started":1}
W20260810 06:41:10.801512 7786 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:10.796347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:47567 (local address 127.27.41.190:38191)
0810 06:41:10.796537 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:10.796540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:10.796650 (+ 110us) server_negotiation.cc:407] Connection header received
0810 06:41:10.796696 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:10.796697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:10.796712 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:10.796773 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:10.797108 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:10.797705 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:10.798481 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:10.798713 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:10.798776 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:10.801461 (+ 2685us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:47567: BlockingRecv error: recv got EOF from 127.27.41.131:47567 (error 108)
Metrics: {"server-negotiator.queue_time_us":164}
Aug 10 06:41:11 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:11 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:11.565001 7789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:11.559857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:52167)
0810 06:41:11.560081 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:11.560093 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:11.560159 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:11.560311 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:11.560311 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:11.560487 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:11.560542 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:11.560544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:11.561198 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:11.561199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:11.561798 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:11.561800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:11.562156 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:11.562157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:11.562198 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:11.562832 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:11.562837 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:11.564931 (+ 2094us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":131,"threads_started":1}
W20260810 06:41:11.565153 7790 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:11.559976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:52167 (local address 127.27.41.190:38191)
0810 06:41:11.560108 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:11.560110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:11.560141 (+ 31us) server_negotiation.cc:407] Connection header received
0810 06:41:11.560219 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:11.560219 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:11.560229 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:11.560289 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:11.560603 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:11.561102 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:11.561875 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:11.562083 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:11.562141 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:11.565050 (+ 2909us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:52167: BlockingRecv error: recv got EOF from 127.27.41.129:52167 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":57,"threads_started":1}
Aug 10 06:41:11 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:11 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:11.682412 7791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:11.677088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:54513)
0810 06:41:11.677323 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:11.677337 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:11.677468 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:11.677628 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:11.677629 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:11.677850 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:11.677923 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:11.677925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:11.678700 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:11.678702 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:11.679250 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:11.679252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:11.679716 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:11.679718 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:11.679780 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:11.680375 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:11.680381 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:11.682345 (+ 1964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":92,"threads_started":1}
W20260810 06:41:11.682490 7790 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:11.677259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:54513 (local address 127.27.41.190:38191)
0810 06:41:11.677382 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:11.677384 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:11.677428 (+ 44us) server_negotiation.cc:407] Connection header received
0810 06:41:11.677546 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:11.677547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:11.677561 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:11.677621 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:11.678021 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:11.678584 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:11.679382 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:11.679613 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:11.679712 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:11.682442 (+ 2730us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:54513: BlockingRecv error: recv got EOF from 127.27.41.130:54513 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 10 06:41:11 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:11 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:11.807471 7792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:11.802043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:42231)
0810 06:41:11.802259 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:11.802273 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:11.802362 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:11.802575 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:11.802577 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:11.802796 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:11.802852 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:11.802854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:11.803708 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:11.803709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:11.804275 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:11.804277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:11.804703 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:11.804704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:11.804770 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:11.805312 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:11.805320 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:11.807381 (+ 2061us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":98,"threads_started":1}
W20260810 06:41:11.807590 7790 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:11.802156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:42231 (local address 127.27.41.190:38191)
0810 06:41:11.802251 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:11.802254 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:11.802358 (+ 104us) server_negotiation.cc:407] Connection header received
0810 06:41:11.802450 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:11.802451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:11.802475 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:11.802550 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:11.802957 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:11.803611 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:11.804399 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:11.804603 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:11.804701 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:11.807517 (+ 2816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:42231: BlockingRecv error: recv got EOF from 127.27.41.131:42231 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 06:41:12 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:12 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:12.575323 7793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:12.565526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:42855)
0810 06:41:12.565789 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:12.565800 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:12.565859 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:12.566002 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:12.566003 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:12.566188 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:12.566239 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:12.566241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:12.566903 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:12.566904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:12.567425 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:12.567426 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:12.567803 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:12.567803 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:12.567847 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:12.572752 (+ 4905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:12.572757 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:12.575213 (+ 2456us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":193,"threads_started":1}
W20260810 06:41:12.575414 7794 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:12.565735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:42855 (local address 127.27.41.190:38191)
0810 06:41:12.565846 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:12.565848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:12.565862 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:41:12.565908 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:12.565909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:12.565919 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:12.565998 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:12.566315 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:12.566830 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:12.567516 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:12.567727 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:12.567786 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:12.575320 (+ 7534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:42855: BlockingRecv error: recv got EOF from 127.27.41.129:42855 (error 108)
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":55,"threads_started":1}
Aug 10 06:41:12 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:12 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:12.688009 7795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:12.682904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:33209)
0810 06:41:12.683052 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:12.683109 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:12.683186 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:12.683334 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:12.683335 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:12.683517 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:12.683572 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:12.683574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:12.684203 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:12.684203 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:12.685162 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:12.685167 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:12.685538 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:12.685539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:12.685597 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:12.686105 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:12.686111 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:12.687946 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":99,"threads_started":1}
W20260810 06:41:12.688151 7794 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:12.682993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:33209 (local address 127.27.41.190:38191)
0810 06:41:12.683075 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:12.683077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:12.683182 (+ 105us) server_negotiation.cc:407] Connection header received
0810 06:41:12.683236 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:12.683237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:12.683248 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:12.683307 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:12.683637 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:12.684137 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:12.685240 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:12.685452 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:12.685510 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:12.688066 (+ 2556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:33209: BlockingRecv error: recv got EOF from 127.27.41.130:33209 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 10 06:41:12 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:12 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.131@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:12.812763 7796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:12.807945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.131:33945)
0810 06:41:12.808130 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:12.808142 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:12.808214 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:12.808364 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:12.808365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:12.808566 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:12.808617 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:12.808620 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:12.809339 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:12.809340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:12.809891 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:12.809892 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:12.810245 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:12.810246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:12.810310 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:12.810811 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:12.810816 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:12.812706 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":99,"threads_started":1}
W20260810 06:41:12.812906 7794 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:12.808007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:33945 (local address 127.27.41.190:38191)
0810 06:41:12.808089 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:12.808091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:12.808199 (+ 108us) server_negotiation.cc:407] Connection header received
0810 06:41:12.808270 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:12.808271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:12.808288 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:12.808356 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:12.808714 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:12.809218 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:12.809975 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:12.810168 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:12.810246 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:12.812815 (+ 2569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.131:33945: BlockingRecv error: recv got EOF from 127.27.41.131:33945 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 06:41:13 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:13 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.129@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:13.580699 7797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:13.575891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.129:40799)
0810 06:41:13.576009 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:13.576020 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:13.576085 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:13.576208 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:13.576209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:13.576369 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:13.576421 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:13.576423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:13.577111 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:13.577112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:13.577717 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:13.577719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:13.578089 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:13.578090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:13.578133 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:13.578602 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:13.578606 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:13.580624 (+ 2018us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":67,"threads_started":1}
W20260810 06:41:13.580777 7798 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:13.575944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:40799 (local address 127.27.41.190:38191)
0810 06:41:13.576094 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:13.576096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:13.576104 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:41:13.576126 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:13.576127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:13.576136 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:13.576200 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:13.576479 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:13.577036 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:13.577795 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:13.578012 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:13.578079 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:13.580720 (+ 2641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.129:40799: BlockingRecv error: recv got EOF from 127.27.41.129:40799 (error 108)
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":98,"threads_started":1}
Aug 10 06:41:13 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:41:13 dist-test-slave-bw88 krb5kdc[6403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.41.130@KRBTEST.COM for oryx/127.27.41.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:41:13.694154 7802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:13.688582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38191 (local address 127.27.41.130:57023)
0810 06:41:13.688866 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:13.688878 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:13.688988 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:13.689163 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:13.689164 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:13.689475 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:13.689542 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:13.689544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:13.690292 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:13.690294 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:13.690859 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:13.690861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:13.691263 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:13.691264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:13.691326 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:13.691877 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:13.691882 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:13.694041 (+ 2159us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.41.190:38191: Server oryx/127.27.41.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":93,"threads_started":1}
W20260810 06:41:13.694196 7798 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:13.688671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:57023 (local address 127.27.41.190:38191)
0810 06:41:13.688861 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:13.688864 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:13.688967 (+ 103us) server_negotiation.cc:407] Connection header received
0810 06:41:13.689062 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:13.689063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:13.689084 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:13.689165 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:13.689637 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:13.690183 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:13.690970 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:13.691168 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:13.691262 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:13.694131 (+ 2869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.41.130:57023: BlockingRecv error: recv got EOF from 127.27.41.130:57023 (error 108)
Metrics: {"server-negotiator.queue_time_us":155}
I20260810 06:41:13.735874 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 7162
I20260810 06:41:13.748951 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 7366
I20260810 06:41:13.759145 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 7553
I20260810 06:41:13.767329 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 7067
2026-08-10T06:41:13Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17745 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-10T06:41:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:41:13Z Disabled control of system clock
I20260810 06:41:13.799341 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:41079
--webserver_interface=127.27.41.190
--webserver_port=0
--builtin_ntp_servers=127.27.41.148:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:41079
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 06:41:13.879419 7807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:41:13.879617 7807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:41:13.879637 7807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:41:13.880707 7807 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:41:13.880743 7807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:41:13.880755 7807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:41:13.880767 7807 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:41:13.880779 7807 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:41:13.882104 7807 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:41079
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:41079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:41:13.882293 7807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:41:13.882529 7807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:41:13.887482 7818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:13.887557 7807 server_base.cc:1034] running on GCE node
W20260810 06:41:13.887529 7814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:13.887552 7816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:13.887995 7807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:41:13.888295 7807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:41:13.889461 7807 hybrid_clock.cc:648] HybridClock initialized: now 1786344073889458 us; error 56 us; skew 500 ppm
I20260810 06:41:13.890724 7807 webserver.cc:460] Webserver started at http://127.27.41.190:33899/ using document root <none> and password file <none>
I20260810 06:41:13.890960 7807 fs_manager.cc:359] Metadata directory not provided
I20260810 06:41:13.891037 7807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:41:13.891209 7807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:41:13.892310 7807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "a8113ae087b7425eb9b4b3844810025e"
format_stamp: "Formatted at 2026-08-10 06:41:13 on dist-test-slave-bw88"
server_key: "efb7b4f7da99296cec5694c006235751"
server_key_iv: "4d4d740bf2b94adb2119d269af64b0e0"
server_key_version: "encryptionkey@0"
I20260810 06:41:13.892697 7807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "a8113ae087b7425eb9b4b3844810025e"
format_stamp: "Formatted at 2026-08-10 06:41:13 on dist-test-slave-bw88"
server_key: "efb7b4f7da99296cec5694c006235751"
server_key_iv: "4d4d740bf2b94adb2119d269af64b0e0"
server_key_version: "encryptionkey@0"
I20260810 06:41:13.894102 7807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:41:13.894845 7831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:13.895018 7807 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:41:13.895124 7807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "a8113ae087b7425eb9b4b3844810025e"
format_stamp: "Formatted at 2026-08-10 06:41:13 on dist-test-slave-bw88"
server_key: "efb7b4f7da99296cec5694c006235751"
server_key_iv: "4d4d740bf2b94adb2119d269af64b0e0"
server_key_version: "encryptionkey@0"
I20260810 06:41:13.895198 7807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:41:13.907066 7807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:41:13.907366 7807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:41:13.907544 7807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:41:13.911566 7807 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:41079
I20260810 06:41:13.911604 7908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:41079 every 8 connection(s)
I20260810 06:41:13.911944 7807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:41:13.912668 7909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:41:13.913792 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 7807
I20260810 06:41:13.913903 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:41:13.914115 27814 external_mini_cluster.cc:1428] Setting key c59d9eddf0b30346c67cbeea2c097d7b
I20260810 06:41:13.916308 7909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e: Bootstrap starting.
I20260810 06:41:13.917009 7909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e: Neither blocks nor log segments found. Creating new log.
I20260810 06:41:13.917366 7909 log.cc:824] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e: Log is configured to *not* fsync() on all Append() calls
I20260810 06:41:13.918135 7909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e: No bootstrap required, opened a new log
I20260810 06:41:13.919713 7913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:13.914701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44598 (local address 127.27.41.190:41079)
0810 06:41:13.914908 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:13.914916 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:13.914941 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:41:13.915347 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:13.915353 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:13.915409 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:13.915537 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:13.915804 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:13.916716 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:13.917844 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:13.918296 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:13.918399 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:13.919054 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:41:13.919057 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:41:13.919057 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:41:13.919216 (+ 159us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:41:13.919248 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:41:13.919258 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:41:13.919311 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:13.919417 (+ 106us) server_negotiation.cc:299] Negotiation successful
0810 06:41:13.919474 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":86,"threads_started":1}
I20260810 06:41:13.920450 7909 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8113ae087b7425eb9b4b3844810025e" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41079 } }
I20260810 06:41:13.920621 7909 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:41:13.920671 7909 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8113ae087b7425eb9b4b3844810025e, State: Initialized, Role: FOLLOWER
I20260810 06:41:13.920804 7909 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8113ae087b7425eb9b4b3844810025e" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41079 } }
I20260810 06:41:13.920900 7909 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:41:13.920945 7909 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:41:13.920995 7909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:41:13.921617 7909 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8113ae087b7425eb9b4b3844810025e" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41079 } }
I20260810 06:41:13.921742 7909 leader_election.cc:302] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8113ae087b7425eb9b4b3844810025e; no voters:
I20260810 06:41:13.921914 7909 leader_election.cc:288] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:41:13.921976 7915 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:41:13.922190 7915 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [term 1 LEADER]: Becoming Leader. State: Replica: a8113ae087b7425eb9b4b3844810025e, State: Running, Role: LEADER
I20260810 06:41:13.922194 7909 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:41:13.922304 7915 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8113ae087b7425eb9b4b3844810025e" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41079 } }
I20260810 06:41:13.922742 7918 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8113ae087b7425eb9b4b3844810025e. Latest consensus state: current_term: 1 leader_uuid: "a8113ae087b7425eb9b4b3844810025e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8113ae087b7425eb9b4b3844810025e" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41079 } } }
I20260810 06:41:13.922750 7916 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8113ae087b7425eb9b4b3844810025e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8113ae087b7425eb9b4b3844810025e" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41079 } } }
I20260810 06:41:13.922931 7916 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [sys.catalog]: This master's current role is: LEADER
I20260810 06:41:13.923197 7918 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e [sys.catalog]: This master's current role is: LEADER
I20260810 06:41:13.923360 7927 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:41:13.923890 7927 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:41:13.925484 7927 catalog_manager.cc:1347] Generated new cluster ID: 1af239cd2d114df3a91dabcbb816e4cd
I20260810 06:41:13.925545 7927 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:41:13.933423 7927 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:41:13.934109 7927 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:41:13.945390 7927 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8113ae087b7425eb9b4b3844810025e: Generated new TSK 0
I20260810 06:41:13.945601 7927 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:41:13.949198 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:41079
--builtin_ntp_servers=127.27.41.148:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 06:41:14.055956 7939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:41:14.056159 7939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:41:14.056181 7939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:41:14.057386 7939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:41:14.057447 7939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:41:14.057473 7939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:41:14.058832 7939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:41079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:41:14.059078 7939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:41:14.059404 7939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:41:14.064584 7947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:14.064596 7946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:14.064594 7952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:14.064903 7939 server_base.cc:1034] running on GCE node
I20260810 06:41:14.065142 7939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:41:14.065444 7939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:41:14.066641 7939 hybrid_clock.cc:648] HybridClock initialized: now 1786344074066618 us; error 37 us; skew 500 ppm
I20260810 06:41:14.068161 7939 webserver.cc:460] Webserver started at http://127.27.41.129:43519/ using document root <none> and password file <none>
I20260810 06:41:14.068460 7939 fs_manager.cc:359] Metadata directory not provided
I20260810 06:41:14.068526 7939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:41:14.068665 7939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:41:14.070089 7939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "d59476f16c1240cfb6801f590afebda3"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "2e978d9084903508b3ef43602a92539f"
server_key_iv: "640efc70ac9b3820c4be4df8db5200cc"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.070497 7939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "d59476f16c1240cfb6801f590afebda3"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "2e978d9084903508b3ef43602a92539f"
server_key_iv: "640efc70ac9b3820c4be4df8db5200cc"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.072368 7939 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260810 06:41:14.073320 7958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.073577 7939 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:41:14.073680 7939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "d59476f16c1240cfb6801f590afebda3"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "2e978d9084903508b3ef43602a92539f"
server_key_iv: "640efc70ac9b3820c4be4df8db5200cc"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.073761 7939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:41:14.098389 7939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:41:14.098685 7939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:41:14.098791 7939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:41:14.098970 7939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:41:14.099334 7939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:41:14.099370 7939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.099395 7939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:41:14.099406 7939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.107061 7939 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:36775
I20260810 06:41:14.107151 8118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:36775 every 8 connection(s)
I20260810 06:41:14.107529 7939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:41:14.112933 7913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:14.108282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:53573 (local address 127.27.41.190:41079)
0810 06:41:14.108325 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:14.108328 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:14.108546 (+ 218us) server_negotiation.cc:407] Connection header received
0810 06:41:14.109145 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:14.109147 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:14.109160 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:14.109210 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:14.109972 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:14.110476 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:14.111498 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:14.111717 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:14.111796 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:14.112617 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:41:14.112619 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:41:14.112620 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:41:14.112625 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:41:14.112640 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:41:14.112645 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:41:14.112719 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:14.112812 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 06:41:14.112854 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:41:14.113165 8121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:14.108246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:41079 (local address 127.27.41.129:53573)
0810 06:41:14.108426 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:14.108459 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:14.109037 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:14.109297 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:14.109307 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:14.109315 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:14.109868 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:14.109873 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:14.110602 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:14.110603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:14.111404 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:14.111406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:14.111806 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:14.111807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:14.111945 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:14.112470 (+ 525us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:41:14.112470 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:14.112498 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:41:14.112521 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:41:14.112722 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:41:14.112729 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:41:14.112732 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:41:14.112814 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 06:41:14.112916 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":70,"threads_started":1}
I20260810 06:41:14.113718 8119 heartbeater.cc:347] Connected to a master server at 127.27.41.190:41079
I20260810 06:41:14.113799 8119 heartbeater.cc:464] Registering TS with master...
I20260810 06:41:14.114001 8119 heartbeater.cc:511] Master 127.27.41.190:41079 requested a full tablet report, sending...
I20260810 06:41:14.114545 7856 ts_manager.cc:194] Registered new tserver with Master: d59476f16c1240cfb6801f590afebda3 (127.27.41.129:36775)
I20260810 06:41:14.115164 7856 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.41.129:53573
I20260810 06:41:14.116389 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 7939
I20260810 06:41:14.116480 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:41:14.116662 27814 external_mini_cluster.cc:1428] Setting key 04bda7baaeba1f2299c5694a00b879b5
I20260810 06:41:14.117540 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:41079
--builtin_ntp_servers=127.27.41.148:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 06:41:14.200749 8122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:41:14.200969 8122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:41:14.201005 8122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:41:14.202198 8122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:41:14.202267 8122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:41:14.202308 8122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:41:14.203641 8122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:41079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:41:14.203902 8122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:41:14.204206 8122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:41:14.209334 8128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:14.209367 8127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:14.209396 8122 server_base.cc:1034] running on GCE node
W20260810 06:41:14.209401 8131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:14.209728 8122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:41:14.210000 8122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:41:14.211169 8122 hybrid_clock.cc:648] HybridClock initialized: now 1786344074211164 us; error 34 us; skew 500 ppm
I20260810 06:41:14.212450 8122 webserver.cc:460] Webserver started at http://127.27.41.130:39639/ using document root <none> and password file <none>
I20260810 06:41:14.212728 8122 fs_manager.cc:359] Metadata directory not provided
I20260810 06:41:14.212798 8122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:41:14.212946 8122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:41:14.214092 8122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "c814fa7952454880ba763f077bb56415"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "861edcf80084d7d22065cf96ac3c6c0c"
server_key_iv: "194bc71ac05a75c475f6248b01669462"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.214464 8122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "c814fa7952454880ba763f077bb56415"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "861edcf80084d7d22065cf96ac3c6c0c"
server_key_iv: "194bc71ac05a75c475f6248b01669462"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.215814 8122 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 06:41:14.216590 8137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.216769 8122 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:41:14.216859 8122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "c814fa7952454880ba763f077bb56415"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "861edcf80084d7d22065cf96ac3c6c0c"
server_key_iv: "194bc71ac05a75c475f6248b01669462"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.216938 8122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:41:14.236272 8122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:41:14.236588 8122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:41:14.236743 8122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:41:14.236979 8122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:41:14.237329 8122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:41:14.237479 8122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.237515 8122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:41:14.237541 8122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.243767 8122 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:36743
I20260810 06:41:14.243824 8298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:36743 every 8 connection(s)
I20260810 06:41:14.244163 8122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:41:14.249241 7913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:14.244941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:41525 (local address 127.27.41.190:41079)
0810 06:41:14.245017 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:14.245020 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:14.245268 (+ 248us) server_negotiation.cc:407] Connection header received
0810 06:41:14.245812 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:14.245813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:14.245823 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:14.245878 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:14.246513 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:14.247010 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:14.247915 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:14.248097 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:14.248148 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:14.248899 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:41:14.248900 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:41:14.248901 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:41:14.248905 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:41:14.248919 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:41:14.248931 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:41:14.248975 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:14.249103 (+ 128us) server_negotiation.cc:299] Negotiation successful
0810 06:41:14.249129 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 06:41:14.249286 8301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:14.244933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:41079 (local address 127.27.41.130:41525)
0810 06:41:14.245144 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:14.245178 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:14.245715 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:14.245930 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:14.245933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:14.245941 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:14.246437 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:14.246441 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:14.247088 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:14.247089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:14.247841 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:14.247843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:14.248169 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:14.248170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:14.248273 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:14.248767 (+ 494us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:41:14.248767 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:14.248795 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:41:14.248817 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:41:14.248987 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:41:14.248992 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:41:14.248994 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:41:14.249055 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 06:41:14.249133 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":105,"threads_started":1}
I20260810 06:41:14.249861 8299 heartbeater.cc:347] Connected to a master server at 127.27.41.190:41079
I20260810 06:41:14.249989 8299 heartbeater.cc:464] Registering TS with master...
I20260810 06:41:14.250200 8299 heartbeater.cc:511] Master 127.27.41.190:41079 requested a full tablet report, sending...
I20260810 06:41:14.250594 7856 ts_manager.cc:194] Registered new tserver with Master: c814fa7952454880ba763f077bb56415 (127.27.41.130:36743)
I20260810 06:41:14.250917 7856 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.41.130:41525
I20260810 06:41:14.252993 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 8122
I20260810 06:41:14.253090 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:41:14.253299 27814 external_mini_cluster.cc:1428] Setting key ac34f6d22aaefdf80a4fe5bc86164626
I20260810 06:41:14.254190 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:41079
--builtin_ntp_servers=127.27.41.148:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 06:41:14.339304 8302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:41:14.339526 8302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:41:14.339566 8302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:41:14.340728 8302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:41:14.340770 8302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:41:14.340793 8302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:41:14.342217 8302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:41079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:41:14.342478 8302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:41:14.342774 8302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:41:14.348084 8312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:14.348091 8309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:14.348155 8310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:14.348265 8302 server_base.cc:1034] running on GCE node
I20260810 06:41:14.348485 8302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:41:14.348789 8302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:41:14.349952 8302 hybrid_clock.cc:648] HybridClock initialized: now 1786344074349923 us; error 51 us; skew 500 ppm
I20260810 06:41:14.351272 8302 webserver.cc:460] Webserver started at http://127.27.41.131:41013/ using document root <none> and password file <none>
I20260810 06:41:14.351524 8302 fs_manager.cc:359] Metadata directory not provided
I20260810 06:41:14.351598 8302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:41:14.351751 8302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:41:14.352842 8302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "e2d36c8b92ab41b2b360271ecf926fad"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "4da7cbfb7b2616e0b7765a4bc329b4c4"
server_key_iv: "86c7ae78cfd4a67679ca023f2e086423"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.353222 8302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "e2d36c8b92ab41b2b360271ecf926fad"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "4da7cbfb7b2616e0b7765a4bc329b4c4"
server_key_iv: "86c7ae78cfd4a67679ca023f2e086423"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.354637 8302 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:41:14.355398 8320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.355584 8302 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:41:14.355691 8302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "e2d36c8b92ab41b2b360271ecf926fad"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "4da7cbfb7b2616e0b7765a4bc329b4c4"
server_key_iv: "86c7ae78cfd4a67679ca023f2e086423"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.355765 8302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:41:14.365049 8302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:41:14.365401 8302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:41:14.365568 8302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:41:14.365803 8302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:41:14.366153 8302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:41:14.366207 8302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.366248 8302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:41:14.366276 8302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.372205 8302 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:37985
I20260810 06:41:14.372292 8479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:37985 every 8 connection(s)
I20260810 06:41:14.372653 8302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:41:14.377956 7913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:14.373449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:49069 (local address 127.27.41.190:41079)
0810 06:41:14.373525 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:14.373528 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:14.373883 (+ 355us) server_negotiation.cc:407] Connection header received
0810 06:41:14.374378 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:14.374379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:14.374389 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:14.374443 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:14.375095 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:14.375580 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:14.376614 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:14.376822 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:14.376875 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:14.377737 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:41:14.377738 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:41:14.377738 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:41:14.377743 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:41:14.377757 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:41:14.377761 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:41:14.377809 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:14.377876 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 06:41:14.377897 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 06:41:14.378137 8483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:14.373555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:41079 (local address 127.27.41.131:49069)
0810 06:41:14.373760 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:14.373793 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:14.374295 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:14.374521 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:14.374525 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:14.374533 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:14.375020 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:14.375025 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:14.375670 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:14.375672 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:14.376534 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:14.376536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:14.376898 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:14.376899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:14.377015 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:14.377600 (+ 585us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:41:14.377601 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:14.377631 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:41:14.377655 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:41:14.377812 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:41:14.377814 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:41:14.377817 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:41:14.377864 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 06:41:14.377941 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":85,"threads_started":1}
I20260810 06:41:14.378677 8480 heartbeater.cc:347] Connected to a master server at 127.27.41.190:41079
I20260810 06:41:14.378779 8480 heartbeater.cc:464] Registering TS with master...
I20260810 06:41:14.378955 8480 heartbeater.cc:511] Master 127.27.41.190:41079 requested a full tablet report, sending...
I20260810 06:41:14.379328 7856 ts_manager.cc:194] Registered new tserver with Master: e2d36c8b92ab41b2b360271ecf926fad (127.27.41.131:37985)
I20260810 06:41:14.379658 7856 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.41.131:49069
I20260810 06:41:14.379992 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 8302
I20260810 06:41:14.380086 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:41:14.380296 27814 external_mini_cluster.cc:1428] Setting key 678de1d1510c3cca9d5c7061e9039eee
I20260810 06:41:14.381084 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 06:41:14.382858 7913 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:14.382459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44610 (local address 127.27.41.190:41079)
0810 06:41:14.382528 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:14.382530 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:14.382621 (+ 91us) server_negotiation.cc:407] Connection header received
0810 06:41:14.382658 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:14.382659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:14.382666 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:14.382718 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:14.382814 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44610: BlockingRecv error: recv got EOF from 127.0.0.1:44610 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 06:41:14.382984 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 7939
I20260810 06:41:14.398813 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 8122
I20260810 06:41:14.409436 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 8302
I20260810 06:41:14.418429 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 7807
2026-08-10T06:41:14Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (651 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-10T06:41:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:41:14Z Disabled control of system clock
I20260810 06:41:14.450627 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38343
--webserver_interface=127.27.41.190
--webserver_port=0
--builtin_ntp_servers=127.27.41.148:36093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:38343
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 06:41:14.532224 8495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:41:14.532428 8495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:41:14.532447 8495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:41:14.533507 8495 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:41:14.533552 8495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:41:14.533565 8495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:41:14.533578 8495 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:41:14.533591 8495 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:41:14.534878 8495 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:38343
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:41:14.535081 8495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:41:14.535313 8495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:41:14.540220 8503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:14.540266 8501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:14.540220 8500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:14.540469 8495 server_base.cc:1034] running on GCE node
I20260810 06:41:14.540723 8495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:41:14.541041 8495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:41:14.542204 8495 hybrid_clock.cc:648] HybridClock initialized: now 1786344074542205 us; error 45 us; skew 500 ppm
I20260810 06:41:14.543443 8495 webserver.cc:460] Webserver started at http://127.27.41.190:41827/ using document root <none> and password file <none>
I20260810 06:41:14.543715 8495 fs_manager.cc:359] Metadata directory not provided
I20260810 06:41:14.543785 8495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:41:14.543932 8495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:41:14.545008 8495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "71be344d5d9743fa9463c0e6f4b33f9c"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "72444df6912fabf70c995fc96ff20ff0"
server_key_iv: "070db89027e253c5addaf8b29c8048d2"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.545537 8495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "71be344d5d9743fa9463c0e6f4b33f9c"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "72444df6912fabf70c995fc96ff20ff0"
server_key_iv: "070db89027e253c5addaf8b29c8048d2"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.546820 8495 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:41:14.547523 8511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.547698 8495 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:41:14.547803 8495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "71be344d5d9743fa9463c0e6f4b33f9c"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "72444df6912fabf70c995fc96ff20ff0"
server_key_iv: "070db89027e253c5addaf8b29c8048d2"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.547876 8495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:41:14.551841 8495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:41:14.552117 8495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:41:14.552265 8495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:41:14.556598 8495 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:38343
I20260810 06:41:14.556658 8583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:38343 every 8 connection(s)
I20260810 06:41:14.557015 8495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:41:14.557857 8584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:41:14.561065 8584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c: Bootstrap starting.
I20260810 06:41:14.561749 8584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c: Neither blocks nor log segments found. Creating new log.
I20260810 06:41:14.562073 8584 log.cc:824] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c: Log is configured to *not* fsync() on all Append() calls
I20260810 06:41:14.562799 8584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c: No bootstrap required, opened a new log
I20260810 06:41:14.564404 8584 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71be344d5d9743fa9463c0e6f4b33f9c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38343 } }
I20260810 06:41:14.564543 8584 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:41:14.564620 8584 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71be344d5d9743fa9463c0e6f4b33f9c, State: Initialized, Role: FOLLOWER
I20260810 06:41:14.564764 8584 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71be344d5d9743fa9463c0e6f4b33f9c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38343 } }
I20260810 06:41:14.564850 8584 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:41:14.564845 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 8495
I20260810 06:41:14.564890 8584 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:41:14.564935 8584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:41:14.564955 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:41:14.565176 27814 external_mini_cluster.cc:1428] Setting key 586e67dcbb0581dd26b375e345d825da
I20260810 06:41:14.565745 8584 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71be344d5d9743fa9463c0e6f4b33f9c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38343 } }
I20260810 06:41:14.565858 8584 leader_election.cc:302] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71be344d5d9743fa9463c0e6f4b33f9c; no voters:
I20260810 06:41:14.566011 8584 leader_election.cc:288] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:41:14.566043 8592 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:41:14.566159 8592 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [term 1 LEADER]: Becoming Leader. State: Replica: 71be344d5d9743fa9463c0e6f4b33f9c, State: Running, Role: LEADER
I20260810 06:41:14.566244 8592 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71be344d5d9743fa9463c0e6f4b33f9c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38343 } }
I20260810 06:41:14.566288 8584 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:41:14.566784 8595 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71be344d5d9743fa9463c0e6f4b33f9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71be344d5d9743fa9463c0e6f4b33f9c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38343 } } }
I20260810 06:41:14.567065 8595 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [sys.catalog]: This master's current role is: LEADER
I20260810 06:41:14.566993 8594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71be344d5d9743fa9463c0e6f4b33f9c. Latest consensus state: current_term: 1 leader_uuid: "71be344d5d9743fa9463c0e6f4b33f9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71be344d5d9743fa9463c0e6f4b33f9c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38343 } } }
I20260810 06:41:14.567335 8594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c [sys.catalog]: This master's current role is: LEADER
I20260810 06:41:14.567685 8600 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:41:14.567793 8591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:14.565714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40526 (local address 127.27.41.190:38343)
0810 06:41:14.565957 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:14.565966 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:14.565994 (+ 28us) server_negotiation.cc:407] Connection header received
0810 06:41:14.566138 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:14.566145 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:14.566196 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:14.566614 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:14.567089 (+ 475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:41:14.567094 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:41:14.567094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:41:14.567099 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:41:14.567148 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:41:14.567165 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:41:14.567231 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:14.567491 (+ 260us) server_negotiation.cc:299] Negotiation successful
0810 06:41:14.567562 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":93,"threads_started":1}
I20260810 06:41:14.568233 8600 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:41:14.569752 8600 catalog_manager.cc:1347] Generated new cluster ID: 3c2df58fa5ba446481797931a66620ec
I20260810 06:41:14.569808 8600 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:41:14.584111 8600 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:41:14.584282 8600 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:41:14.589375 8600 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71be344d5d9743fa9463c0e6f4b33f9c: Generated new TSK 0
I20260810 06:41:14.589592 8600 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:41:14.596050 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38343
--builtin_ntp_servers=127.27.41.148:36093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 06:41:14.678404 8620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:41:14.678609 8620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:41:14.678630 8620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:41:14.679785 8620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:41:14.679823 8620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:41:14.679848 8620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:41:14.681232 8620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:41:14.681536 8620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:41:14.681830 8620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:41:14.687129 8627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:14.687196 8620 server_base.cc:1034] running on GCE node
W20260810 06:41:14.687300 8630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:14.687150 8628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:14.687554 8620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:41:14.687809 8620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:41:14.688961 8620 hybrid_clock.cc:648] HybridClock initialized: now 1786344074688950 us; error 27 us; skew 500 ppm
I20260810 06:41:14.690341 8620 webserver.cc:460] Webserver started at http://127.27.41.129:44973/ using document root <none> and password file <none>
I20260810 06:41:14.690579 8620 fs_manager.cc:359] Metadata directory not provided
I20260810 06:41:14.690626 8620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:41:14.690754 8620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:41:14.691836 8620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "7306f13c3389427c92e8d70f66a8f1cb"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "d68babf72be8502bf10e2bc0855aed94"
server_key_iv: "235b055dcc4eedb16908f2663846c846"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.692209 8620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "7306f13c3389427c92e8d70f66a8f1cb"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "d68babf72be8502bf10e2bc0855aed94"
server_key_iv: "235b055dcc4eedb16908f2663846c846"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.693626 8620 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:41:14.694411 8639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.694604 8620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:41:14.694718 8620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "7306f13c3389427c92e8d70f66a8f1cb"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "d68babf72be8502bf10e2bc0855aed94"
server_key_iv: "235b055dcc4eedb16908f2663846c846"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.694794 8620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:41:14.698035 8620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:41:14.698288 8620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:41:14.698426 8620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:41:14.698639 8620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:41:14.698928 8620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:41:14.698987 8620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.699028 8620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:41:14.699055 8620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.705308 8620 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:34843
I20260810 06:41:14.705374 8786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:34843 every 8 connection(s)
I20260810 06:41:14.705679 8620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:41:14.708523 8591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:14.706380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:56931 (local address 127.27.41.190:38343)
0810 06:41:14.706424 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:14.706426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:14.706731 (+ 305us) server_negotiation.cc:407] Connection header received
0810 06:41:14.707197 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:14.707198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:14.707205 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:14.707257 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:14.708347 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:41:14.708348 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:41:14.708348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:41:14.708353 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:41:14.708368 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:41:14.708371 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:41:14.708417 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:14.708461 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 06:41:14.708473 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:41:14.708695 8793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:14.706378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38343 (local address 127.27.41.129:56931)
0810 06:41:14.706581 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:14.706622 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:14.707107 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:14.707305 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:14.707308 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:14.707315 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:14.708216 (+ 901us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:41:14.708216 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:14.708241 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:41:14.708267 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:41:14.708414 (+ 147us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:41:14.708416 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:41:14.708418 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:41:14.708467 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 06:41:14.708512 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":92,"threads_started":1}
I20260810 06:41:14.709221 8787 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38343
I20260810 06:41:14.709296 8787 heartbeater.cc:464] Registering TS with master...
I20260810 06:41:14.709463 8787 heartbeater.cc:511] Master 127.27.41.190:38343 requested a full tablet report, sending...
I20260810 06:41:14.709945 8537 ts_manager.cc:194] Registered new tserver with Master: 7306f13c3389427c92e8d70f66a8f1cb (127.27.41.129:34843)
I20260810 06:41:14.711741 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 8620
I20260810 06:41:14.711830 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:41:14.711978 27814 external_mini_cluster.cc:1428] Setting key fca181dd01c27a01db2401eaaf70c7be
I20260810 06:41:14.712814 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38343
--builtin_ntp_servers=127.27.41.148:36093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 06:41:14.794668 8794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:41:14.794869 8794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:41:14.794890 8794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:41:14.795955 8794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:41:14.795989 8794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:41:14.796031 8794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:41:14.797376 8794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:41:14.797624 8794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:41:14.797924 8794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:41:14.803011 8801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:14.802982 8802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:14.803205 8794 server_base.cc:1034] running on GCE node
W20260810 06:41:14.802989 8804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:14.803459 8794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:41:14.803745 8794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:41:14.804916 8794 hybrid_clock.cc:648] HybridClock initialized: now 1786344074804893 us; error 41 us; skew 500 ppm
I20260810 06:41:14.806250 8794 webserver.cc:460] Webserver started at http://127.27.41.130:39215/ using document root <none> and password file <none>
I20260810 06:41:14.806527 8794 fs_manager.cc:359] Metadata directory not provided
I20260810 06:41:14.806602 8794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:41:14.806782 8794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:41:14.807933 8794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "c492493d2185496aac3d51a8546e46da"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "7c5f64f66affc7ff3500f9a539e1c439"
server_key_iv: "b8aff0bd35110f88263094556f22e612"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.808274 8794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "c492493d2185496aac3d51a8546e46da"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "7c5f64f66affc7ff3500f9a539e1c439"
server_key_iv: "b8aff0bd35110f88263094556f22e612"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.809576 8794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:41:14.810268 8813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.810469 8794 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:41:14.810545 8794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "c492493d2185496aac3d51a8546e46da"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "7c5f64f66affc7ff3500f9a539e1c439"
server_key_iv: "b8aff0bd35110f88263094556f22e612"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.810599 8794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:41:14.813865 8794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:41:14.814080 8794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:41:14.814174 8794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:41:14.814321 8794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:41:14.814640 8794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:41:14.814688 8794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.814709 8794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:41:14.814755 8794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.820748 8794 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:45807
I20260810 06:41:14.820832 8961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:45807 every 8 connection(s)
I20260810 06:41:14.821128 8794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:41:14.824158 8591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:14.821904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:42663 (local address 127.27.41.190:38343)
0810 06:41:14.821981 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:14.821983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:14.822199 (+ 216us) server_negotiation.cc:407] Connection header received
0810 06:41:14.822672 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:14.822673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:14.822679 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:14.822747 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:14.823959 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:41:14.823961 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:41:14.823961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:41:14.823965 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:41:14.823981 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:41:14.823986 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:41:14.824039 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:14.824093 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 06:41:14.824105 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 06:41:14.824370 8965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:14.821861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38343 (local address 127.27.41.130:42663)
0810 06:41:14.822064 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:14.822104 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:14.822585 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:14.822811 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:14.822814 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:14.822822 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:14.823812 (+ 990us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:41:14.823813 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:14.823840 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:41:14.823869 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:41:14.824042 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:41:14.824044 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:41:14.824046 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:41:14.824094 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 06:41:14.824140 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
I20260810 06:41:14.824828 8962 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38343
I20260810 06:41:14.824930 8962 heartbeater.cc:464] Registering TS with master...
I20260810 06:41:14.825091 8962 heartbeater.cc:511] Master 127.27.41.190:38343 requested a full tablet report, sending...
I20260810 06:41:14.825500 8537 ts_manager.cc:194] Registered new tserver with Master: c492493d2185496aac3d51a8546e46da (127.27.41.130:45807)
I20260810 06:41:14.828254 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 8794
I20260810 06:41:14.828372 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:41:14.828568 27814 external_mini_cluster.cc:1428] Setting key 56754edc40d5edd51f2ad38f13cbee13
I20260810 06:41:14.829594 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38343
--builtin_ntp_servers=127.27.41.148:36093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 06:41:14.913699 8966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:41:14.913942 8966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:41:14.913982 8966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:41:14.915153 8966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:41:14.915225 8966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:41:14.915269 8966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:41:14.916610 8966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:36093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:41:14.916859 8966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:41:14.917143 8966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:41:14.922199 8975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:14.922281 8966 server_base.cc:1034] running on GCE node
W20260810 06:41:14.922210 8973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:14.922209 8972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:14.922640 8966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:41:14.922941 8966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:41:14.924110 8966 hybrid_clock.cc:648] HybridClock initialized: now 1786344074924084 us; error 54 us; skew 500 ppm
I20260810 06:41:14.925655 8966 webserver.cc:460] Webserver started at http://127.27.41.131:46497/ using document root <none> and password file <none>
I20260810 06:41:14.925923 8966 fs_manager.cc:359] Metadata directory not provided
I20260810 06:41:14.925994 8966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:41:14.926136 8966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:41:14.927191 8966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "1af8fa62be414a70b3db33306bb51cc0"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "df72454a81c9650eaebcf1745edf7c7d"
server_key_iv: "4c1ce083e5bdb54b09f3f80dd66e0bf1"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.927575 8966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "1af8fa62be414a70b3db33306bb51cc0"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "df72454a81c9650eaebcf1745edf7c7d"
server_key_iv: "4c1ce083e5bdb54b09f3f80dd66e0bf1"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.928959 8966 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:41:14.929769 8986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.929946 8966 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.930061 8966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "1af8fa62be414a70b3db33306bb51cc0"
format_stamp: "Formatted at 2026-08-10 06:41:14 on dist-test-slave-bw88"
server_key: "df72454a81c9650eaebcf1745edf7c7d"
server_key_iv: "4c1ce083e5bdb54b09f3f80dd66e0bf1"
server_key_version: "encryptionkey@0"
I20260810 06:41:14.930143 8966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:41:14.933470 8966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:41:14.933771 8966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:41:14.933913 8966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:41:14.934132 8966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:41:14.934440 8966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:41:14.934502 8966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.934543 8966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:41:14.934571 8966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:14.940605 8966 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:42423
I20260810 06:41:14.940651 9136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:42423 every 8 connection(s)
I20260810 06:41:14.940955 8966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:41:14.943889 8591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:14.941724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:50993 (local address 127.27.41.190:38343)
0810 06:41:14.941788 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:14.941791 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:14.942026 (+ 235us) server_negotiation.cc:407] Connection header received
0810 06:41:14.942462 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:14.942463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:14.942468 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:14.942522 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:14.943720 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:41:14.943721 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:41:14.943721 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:41:14.943724 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:41:14.943734 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:41:14.943737 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:41:14.943779 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:14.943825 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 06:41:14.943836 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 06:41:14.944118 9139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:14.941714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38343 (local address 127.27.41.131:50993)
0810 06:41:14.941897 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:14.941931 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:14.942379 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:14.942579 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:14.942582 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:14.942590 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:14.943589 (+ 999us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:41:14.943590 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:14.943619 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:41:14.943647 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:41:14.943779 (+ 132us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:41:14.943781 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:41:14.943783 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:41:14.943833 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 06:41:14.943878 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":98,"threads_started":1}
I20260810 06:41:14.944563 9137 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38343
I20260810 06:41:14.944660 9137 heartbeater.cc:464] Registering TS with master...
I20260810 06:41:14.944779 9137 heartbeater.cc:511] Master 127.27.41.190:38343 requested a full tablet report, sending...
I20260810 06:41:14.945139 8537 ts_manager.cc:194] Registered new tserver with Master: 1af8fa62be414a70b3db33306bb51cc0 (127.27.41.131:42423)
I20260810 06:41:14.945207 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 8966
I20260810 06:41:14.945333 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:41:14.945612 27814 external_mini_cluster.cc:1428] Setting key f5586f60abe34f248496db5e74f55657
I20260810 06:41:14.946467 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 06:41:14.948374 8591 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:41:14.947865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40538 (local address 127.27.41.190:38343)
0810 06:41:14.947923 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:14.947926 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:14.948069 (+ 143us) server_negotiation.cc:407] Connection header received
0810 06:41:14.948107 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:14.948108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:14.948112 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:14.948154 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:14.948313 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40538: BlockingRecv error: recv got EOF from 127.0.0.1:40538 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 06:41:14.948424 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 8620
I20260810 06:41:14.962630 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 8794
I20260810 06:41:14.974488 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 8966
I20260810 06:41:14.983762 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 8495
2026-08-10T06:41:14Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (565 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:41:15 dist-test-slave-bw88 krb5kdc[9152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:41:15 dist-test-slave-bw88 krb5kdc[9152](info): set up 2 sockets
Aug 10 06:41:15 dist-test-slave-bw88 krb5kdc[9152](info): commencing operation
krb5kdc: starting...
W20260810 06:41:16.183888 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:41:16 dist-test-slave-bw88 krb5kdc[9152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:41:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:41:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:41:16.308873 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:42743
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:40679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:42743
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:41:16.391688 9169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:41:16.391919 9169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:41:16.391957 9169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:41:16.393106 9169 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:41:16.393172 9169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:41:16.393198 9169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:41:16.393229 9169 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:41:16.393252 9169 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:41:16.394788 9169 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:40679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:42743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:42743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:41:16.395095 9169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:41:16.395354 9169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:41:16.400199 9181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:16.400398 9169 server_base.cc:1034] running on GCE node
W20260810 06:41:16.400228 9175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:16.400192 9179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:16.400774 9169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:41:16.401100 9169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:41:16.402293 9169 hybrid_clock.cc:648] HybridClock initialized: now 1786344076402291 us; error 43 us; skew 500 ppm
Aug 10 06:41:16 dist-test-slave-bw88 krb5kdc[9152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344076, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:41:16.404834 9169 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:41:16.405301 9169 webserver.cc:460] Webserver started at http://127.27.41.190:42247/ using document root <none> and password file <none>
I20260810 06:41:16.405587 9169 fs_manager.cc:359] Metadata directory not provided
I20260810 06:41:16.405660 9169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:41:16.405815 9169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:41:16.406852 9169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "400a5b6227b9490b8e2b4cb8a8816908"
format_stamp: "Formatted at 2026-08-10 06:41:16 on dist-test-slave-bw88"
server_key: "50af9ec9c24d5497d859ff4f87f9a74b"
server_key_iv: "b24eec3aae8593474b29436963ace2b2"
server_key_version: "encryptionkey@0"
I20260810 06:41:16.407228 9169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "400a5b6227b9490b8e2b4cb8a8816908"
format_stamp: "Formatted at 2026-08-10 06:41:16 on dist-test-slave-bw88"
server_key: "50af9ec9c24d5497d859ff4f87f9a74b"
server_key_iv: "b24eec3aae8593474b29436963ace2b2"
server_key_version: "encryptionkey@0"
I20260810 06:41:16.408717 9169 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:41:16.409715 9191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:16.409904 9169 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:41:16.410038 9169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "400a5b6227b9490b8e2b4cb8a8816908"
format_stamp: "Formatted at 2026-08-10 06:41:16 on dist-test-slave-bw88"
server_key: "50af9ec9c24d5497d859ff4f87f9a74b"
server_key_iv: "b24eec3aae8593474b29436963ace2b2"
server_key_version: "encryptionkey@0"
I20260810 06:41:16.410130 9169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:41:16.430720 9169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:41:16.432842 9169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:41:16.433055 9169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:41:16.437924 9169 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:42743
I20260810 06:41:16.437968 9254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:42743 every 8 connection(s)
I20260810 06:41:16.438369 9169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:41:16.439467 9255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:41:16.441919 9255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908: Bootstrap starting.
I20260810 06:41:16.442524 9255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908: Neither blocks nor log segments found. Creating new log.
I20260810 06:41:16.442836 9255 log.cc:824] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908: Log is configured to *not* fsync() on all Append() calls
I20260810 06:41:16.443602 9255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908: No bootstrap required, opened a new log
I20260810 06:41:16.444355 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 9169
I20260810 06:41:16.444465 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:41:16.444677 27814 external_mini_cluster.cc:1428] Setting key 7a85b4e3e8677ebdf273d565add38d61
I20260810 06:41:16.445854 9255 raft_consensus.cc:348] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "400a5b6227b9490b8e2b4cb8a8816908" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 42743 } }
I20260810 06:41:16.446017 9255 raft_consensus.cc:374] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:41:16.446056 9255 raft_consensus.cc:729] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 400a5b6227b9490b8e2b4cb8a8816908, State: Initialized, Role: FOLLOWER
I20260810 06:41:16.446223 9255 consensus_queue.cc:260] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "400a5b6227b9490b8e2b4cb8a8816908" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 42743 } }
I20260810 06:41:16.446318 9255 raft_consensus.cc:388] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:41:16.446355 9255 raft_consensus.cc:482] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:41:16.446404 9255 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:41:16.447407 9255 raft_consensus.cc:504] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "400a5b6227b9490b8e2b4cb8a8816908" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 42743 } }
I20260810 06:41:16.447499 9255 leader_election.cc:302] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 400a5b6227b9490b8e2b4cb8a8816908; no voters:
I20260810 06:41:16.447683 9255 leader_election.cc:288] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:41:16.447723 9261 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:41:16.447940 9261 raft_consensus.cc:686] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [term 1 LEADER]: Becoming Leader. State: Replica: 400a5b6227b9490b8e2b4cb8a8816908, State: Running, Role: LEADER
I20260810 06:41:16.447995 9255 sys_catalog.cc:564] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:41:16.448118 9261 consensus_queue.cc:237] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "400a5b6227b9490b8e2b4cb8a8816908" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 42743 } }
I20260810 06:41:16.448539 9263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "400a5b6227b9490b8e2b4cb8a8816908" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "400a5b6227b9490b8e2b4cb8a8816908" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 42743 } } }
I20260810 06:41:16.448628 9263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [sys.catalog]: This master's current role is: LEADER
I20260810 06:41:16.449508 9272 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:41:16.449764 9262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 400a5b6227b9490b8e2b4cb8a8816908. Latest consensus state: current_term: 1 leader_uuid: "400a5b6227b9490b8e2b4cb8a8816908" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "400a5b6227b9490b8e2b4cb8a8816908" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 42743 } } }
I20260810 06:41:16.449838 9262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908 [sys.catalog]: This master's current role is: LEADER
I20260810 06:41:16.450155 9272 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:41:16.451807 9272 catalog_manager.cc:1347] Generated new cluster ID: 6e23e8ea0a4f4d7e9deb29214abe688a
I20260810 06:41:16.451874 9272 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:41:16 dist-test-slave-bw88 krb5kdc[9152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:41:16.456624 9260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:16.445269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60166 (local address 127.27.41.190:42743)
0810 06:41:16.445553 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:16.445562 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:16.445589 (+ 27us) server_negotiation.cc:407] Connection header received
0810 06:41:16.445838 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:16.445844 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:16.445892 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:16.446048 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:16.446874 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.448036 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.449158 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.449858 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.449991 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:16.452696 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:41:16.452699 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:41:16.452700 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:41:16.452712 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:41:16.454829 (+ 2117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:41:16.455295 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:41:16.455298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:41:16.455299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:41:16.455445 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:41:16.455689 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:41:16.455690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:41:16.455690 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:41:16.455980 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:41:16.456147 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:16.456253 (+ 106us) server_negotiation.cc:299] Negotiation successful
0810 06:41:16.456395 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":182,"threads_started":1}
I20260810 06:41:16.471931 9272 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:41:16.472545 9272 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:41:16.482486 9272 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908: Generated new TSK 0
I20260810 06:41:16.482705 9272 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:41:16.516381 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:42743
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:40679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:41:16.602742 9286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:41:16.602983 9286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:41:16.603021 9286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:41:16.604143 9286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:41:16.604212 9286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:41:16.604256 9286 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:41:16.605736 9286 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:40679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:42743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:41:16.606002 9286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:41:16.606232 9286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:41:16.611476 9293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:16.611590 9294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:16.611476 9296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:16.612058 9286 server_base.cc:1034] running on GCE node
I20260810 06:41:16.612303 9286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:41:16.612571 9286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:41:16.613755 9286 hybrid_clock.cc:648] HybridClock initialized: now 1786344076613734 us; error 39 us; skew 500 ppm
Aug 10 06:41:16 dist-test-slave-bw88 krb5kdc[9152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344076, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:41:16.616290 9286 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:41:16.616719 9286 webserver.cc:460] Webserver started at http://127.27.41.129:41577/ using document root <none> and password file <none>
I20260810 06:41:16.616950 9286 fs_manager.cc:359] Metadata directory not provided
I20260810 06:41:16.617019 9286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:41:16.617189 9286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:41:16.618330 9286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "394315f42b7940ff8037686c0270494d"
format_stamp: "Formatted at 2026-08-10 06:41:16 on dist-test-slave-bw88"
server_key: "d9a23afc6bfb76f2b776714dd7ccf223"
server_key_iv: "cb0521de0113c7cd2bba5237453f734a"
server_key_version: "encryptionkey@0"
I20260810 06:41:16.618712 9286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "394315f42b7940ff8037686c0270494d"
format_stamp: "Formatted at 2026-08-10 06:41:16 on dist-test-slave-bw88"
server_key: "d9a23afc6bfb76f2b776714dd7ccf223"
server_key_iv: "cb0521de0113c7cd2bba5237453f734a"
server_key_version: "encryptionkey@0"
I20260810 06:41:16.620072 9286 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:41:16.620826 9303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:16.621002 9286 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:41:16.621115 9286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "394315f42b7940ff8037686c0270494d"
format_stamp: "Formatted at 2026-08-10 06:41:16 on dist-test-slave-bw88"
server_key: "d9a23afc6bfb76f2b776714dd7ccf223"
server_key_iv: "cb0521de0113c7cd2bba5237453f734a"
server_key_version: "encryptionkey@0"
I20260810 06:41:16.621225 9286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:41:16.647531 9286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:41:16.649861 9286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:41:16.650040 9286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:41:16.650305 9286 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:41:16.650656 9286 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:41:16.650715 9286 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:16.650753 9286 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:41:16.650799 9286 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:16.656842 9286 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:36583
I20260810 06:41:16.656896 9439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:36583 every 8 connection(s)
I20260810 06:41:16.657222 9286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:41:16.662536 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 9286
I20260810 06:41:16.662657 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:41:16.662879 27814 external_mini_cluster.cc:1428] Setting key f38810d641d15cd89d5c5b67fde6d809
Aug 10 06:41:16 dist-test-slave-bw88 krb5kdc[9152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344076, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:41:16.667303 9443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:16.658067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:42743 (local address 127.27.41.129:60977)
0810 06:41:16.658250 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:16.658289 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:16.658770 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:16.658973 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:16.658976 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:16.659568 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:16.659811 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:16.659818 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.660507 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.660508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:16.661390 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:16.661393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.661748 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.661749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:16.661853 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:16.662352 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:16.662363 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:16.664132 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:41:16.665801 (+ 1669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:41:16.665809 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:41:16.665811 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:41:16.666141 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:41:16.666335 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:41:16.666336 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:41:16.666336 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:41:16.666482 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:41:16.666728 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:41:16.666735 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:41:16.666887 (+ 152us) client_negotiation.cc:769] Sending connection context
0810 06:41:16.667016 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 06:41:16.667142 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":108,"threads_started":1}
I20260810 06:41:16.667307 9260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:16.658091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:60977 (local address 127.27.41.190:42743)
0810 06:41:16.658166 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:16.658168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:16.658380 (+ 212us) server_negotiation.cc:407] Connection header received
0810 06:41:16.658853 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:16.658854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:16.658865 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:16.658918 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:16.659902 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.660412 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.661462 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.661672 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.661726 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:16.664233 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:41:16.664235 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:41:16.664236 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:41:16.664245 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:41:16.665711 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:41:16.666217 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:41:16.666218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:41:16.666219 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:41:16.666270 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:41:16.666556 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:41:16.666556 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:41:16.666556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:41:16.666662 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:41:16.666713 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:16.667063 (+ 350us) server_negotiation.cc:299] Negotiation successful
0810 06:41:16.667166 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 06:41:16.667845 9440 heartbeater.cc:347] Connected to a master server at 127.27.41.190:42743
I20260810 06:41:16.667953 9440 heartbeater.cc:464] Registering TS with master...
I20260810 06:41:16.668149 9440 heartbeater.cc:511] Master 127.27.41.190:42743 requested a full tablet report, sending...
I20260810 06:41:16.668773 9209 ts_manager.cc:194] Registered new tserver with Master: 394315f42b7940ff8037686c0270494d (127.27.41.129:36583)
I20260810 06:41:16.669557 9209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:60977
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:41:16.691430 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:42743
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:40679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:41:16.774605 9446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:41:16.774799 9446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:41:16.774822 9446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:41:16.775851 9446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:41:16.775883 9446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:41:16.775909 9446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:41:16.777215 9446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:40679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:42743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:41:16.777457 9446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:41:16.777634 9446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:41:16.782680 9452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:16.782802 9446 server_base.cc:1034] running on GCE node
W20260810 06:41:16.782660 9455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:16.782645 9453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:16.783118 9446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:41:16.783368 9446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:41:16.784533 9446 hybrid_clock.cc:648] HybridClock initialized: now 1786344076784508 us; error 38 us; skew 500 ppm
Aug 10 06:41:16 dist-test-slave-bw88 krb5kdc[9152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344076, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:41:16.787292 9446 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:41:16.787727 9446 webserver.cc:460] Webserver started at http://127.27.41.130:39191/ using document root <none> and password file <none>
I20260810 06:41:16.787950 9446 fs_manager.cc:359] Metadata directory not provided
I20260810 06:41:16.787995 9446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:41:16.788133 9446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:41:16.789141 9446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "02612598dd634637bf9625df816eb47f"
format_stamp: "Formatted at 2026-08-10 06:41:16 on dist-test-slave-bw88"
server_key: "34d394231c1b988934fa4a7f96266a9c"
server_key_iv: "2b0f13e688203c943ca4fc25649ea606"
server_key_version: "encryptionkey@0"
I20260810 06:41:16.789592 9446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "02612598dd634637bf9625df816eb47f"
format_stamp: "Formatted at 2026-08-10 06:41:16 on dist-test-slave-bw88"
server_key: "34d394231c1b988934fa4a7f96266a9c"
server_key_iv: "2b0f13e688203c943ca4fc25649ea606"
server_key_version: "encryptionkey@0"
I20260810 06:41:16.790968 9446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:41:16.791769 9463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:16.791975 9446 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:41:16.792076 9446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "02612598dd634637bf9625df816eb47f"
format_stamp: "Formatted at 2026-08-10 06:41:16 on dist-test-slave-bw88"
server_key: "34d394231c1b988934fa4a7f96266a9c"
server_key_iv: "2b0f13e688203c943ca4fc25649ea606"
server_key_version: "encryptionkey@0"
I20260810 06:41:16.792156 9446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:41:16.812495 9446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:41:16.814637 9446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:41:16.814805 9446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:41:16.815047 9446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:41:16.815359 9446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:41:16.815416 9446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:16.815457 9446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:41:16.815483 9446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:16.821825 9446 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:37979
I20260810 06:41:16.821902 9605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:37979 every 8 connection(s)
I20260810 06:41:16.822242 9446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:41:16.826648 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 9446
I20260810 06:41:16.826768 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:41:16.826968 27814 external_mini_cluster.cc:1428] Setting key 1ef9be093631b2a31ed06055bc0c40b6
Aug 10 06:41:16 dist-test-slave-bw88 krb5kdc[9152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344076, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:41:16.832682 9260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:16.823063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:44353 (local address 127.27.41.190:42743)
0810 06:41:16.823111 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:16.823113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:16.823299 (+ 186us) server_negotiation.cc:407] Connection header received
0810 06:41:16.823895 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:16.823897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:16.823911 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:16.823963 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:16.824944 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.825529 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.826599 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.826867 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.826931 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:16.829494 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:41:16.829496 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:41:16.829496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:41:16.829504 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:41:16.830961 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:41:16.831589 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:41:16.831590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:41:16.831590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:41:16.831646 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:41:16.831995 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:41:16.831995 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:41:16.831995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:41:16.832106 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:41:16.832158 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:16.832546 (+ 388us) server_negotiation.cc:299] Negotiation successful
0810 06:41:16.832619 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:41:16.833098 9608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:16.823024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:42743 (local address 127.27.41.130:44353)
0810 06:41:16.823168 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:16.823213 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:16.823752 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:16.824035 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:16.824039 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:16.824640 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:16.824831 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:16.824835 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.825629 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.825630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:16.826503 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:16.826506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.826949 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.826950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:16.827120 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:16.827743 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:16.827754 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:16.829397 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:41:16.831107 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:41:16.831117 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:41:16.831119 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:41:16.831501 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:41:16.831733 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:41:16.831734 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:41:16.831734 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:41:16.831918 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:41:16.832181 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:41:16.832188 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:41:16.832390 (+ 202us) client_negotiation.cc:769] Sending connection context
0810 06:41:16.832533 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 06:41:16.832763 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":63,"threads_started":1}
I20260810 06:41:16.833693 9606 heartbeater.cc:347] Connected to a master server at 127.27.41.190:42743
I20260810 06:41:16.833791 9606 heartbeater.cc:464] Registering TS with master...
I20260810 06:41:16.833971 9606 heartbeater.cc:511] Master 127.27.41.190:42743 requested a full tablet report, sending...
I20260810 06:41:16.834427 9209 ts_manager.cc:194] Registered new tserver with Master: 02612598dd634637bf9625df816eb47f (127.27.41.130:37979)
I20260810 06:41:16.834828 9209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:44353
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:41:16.856817 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:42743
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:40679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:41:16.941241 9611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:41:16.941535 9611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:41:16.941578 9611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:41:16.942737 9611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:41:16.942806 9611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:41:16.942853 9611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:41:16.944420 9611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:40679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:42743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:41:16.944679 9611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:41:16.944906 9611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:41:16.950140 9616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:16.950151 9617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:41:16.950256 9621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:41:16.950646 9611 server_base.cc:1034] running on GCE node
I20260810 06:41:16.950841 9611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:41:16.951085 9611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:41:16.952322 9611 hybrid_clock.cc:648] HybridClock initialized: now 1786344076952313 us; error 30 us; skew 500 ppm
Aug 10 06:41:16 dist-test-slave-bw88 krb5kdc[9152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344076, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:41:16.954950 9611 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:41:16.955371 9611 webserver.cc:460] Webserver started at http://127.27.41.131:37667/ using document root <none> and password file <none>
I20260810 06:41:16.955600 9611 fs_manager.cc:359] Metadata directory not provided
I20260810 06:41:16.955668 9611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:41:16.955825 9611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:41:16.957052 9611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "effae9527f174bf58a09238f1c92d25a"
format_stamp: "Formatted at 2026-08-10 06:41:16 on dist-test-slave-bw88"
server_key: "00e311e134e661745c39000943b8e950"
server_key_iv: "5d86d9fdd8a4e0ef03fb47546b3b0e3a"
server_key_version: "encryptionkey@0"
I20260810 06:41:16.957484 9611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "effae9527f174bf58a09238f1c92d25a"
format_stamp: "Formatted at 2026-08-10 06:41:16 on dist-test-slave-bw88"
server_key: "00e311e134e661745c39000943b8e950"
server_key_iv: "5d86d9fdd8a4e0ef03fb47546b3b0e3a"
server_key_version: "encryptionkey@0"
I20260810 06:41:16.958844 9611 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:41:16.959736 9631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:16.959975 9611 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:41:16.960093 9611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "effae9527f174bf58a09238f1c92d25a"
format_stamp: "Formatted at 2026-08-10 06:41:16 on dist-test-slave-bw88"
server_key: "00e311e134e661745c39000943b8e950"
server_key_iv: "5d86d9fdd8a4e0ef03fb47546b3b0e3a"
server_key_version: "encryptionkey@0"
I20260810 06:41:16.960173 9611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:41:16.969692 9611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:41:16.971877 9611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:41:16.972041 9611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:41:16.972267 9611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:41:16.972569 9611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:41:16.972623 9611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:16.972664 9611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:41:16.972690 9611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:41:16.978904 9611 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:40489
I20260810 06:41:16.979024 9768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:40489 every 8 connection(s)
I20260810 06:41:16.979367 9611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:41:16.982362 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 9611
I20260810 06:41:16.982498 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:41:16.982715 27814 external_mini_cluster.cc:1428] Setting key 2ac93bcb1ecc4b5e76132a236992c37a
Aug 10 06:41:16 dist-test-slave-bw88 krb5kdc[9152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344076, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:41:16.989190 9260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:16.980134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:53849 (local address 127.27.41.190:42743)
0810 06:41:16.980214 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:16.980217 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:16.980431 (+ 214us) server_negotiation.cc:407] Connection header received
0810 06:41:16.980939 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:16.980940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:16.980950 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:16.980997 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:16.981972 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.982547 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.983966 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.984183 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.984271 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:16.986416 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:41:16.986418 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:41:16.986418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:41:16.986426 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:41:16.987806 (+ 1380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:41:16.988229 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:41:16.988230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:41:16.988230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:41:16.988294 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:41:16.988549 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:41:16.988550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:41:16.988551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:41:16.988667 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:41:16.988753 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:16.989025 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 06:41:16.989104 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:41:16.989389 9773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:16.980075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:42743 (local address 127.27.41.131:53849)
0810 06:41:16.980271 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:16.980326 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:16.980855 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:16.981058 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:16.981061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:16.981699 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:41:16.981891 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:16.981896 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.982651 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.982657 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:16.983880 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:16.983883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.984284 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.984285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:16.984420 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:16.984924 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:41:16.984933 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:41:16.986318 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:41:16.987908 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:41:16.987916 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:41:16.987918 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:41:16.988151 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:41:16.988364 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:41:16.988365 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:41:16.988365 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:41:16.988477 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:41:16.988756 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:41:16.988763 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:41:16.988893 (+ 130us) client_negotiation.cc:769] Sending connection context
0810 06:41:16.988989 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 06:41:16.989147 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":113,"threads_started":1}
I20260810 06:41:16.989851 9770 heartbeater.cc:347] Connected to a master server at 127.27.41.190:42743
I20260810 06:41:16.989928 9770 heartbeater.cc:464] Registering TS with master...
I20260810 06:41:16.990130 9770 heartbeater.cc:511] Master 127.27.41.190:42743 requested a full tablet report, sending...
I20260810 06:41:16.990629 9209 ts_manager.cc:194] Registered new tserver with Master: effae9527f174bf58a09238f1c92d25a (127.27.41.131:40489)
I20260810 06:41:16.990958 9209 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:53849
I20260810 06:41:16.994349 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:41:17.001612 9260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:16.995691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60172 (local address 127.27.41.190:42743)
0810 06:41:16.995738 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:16.995740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:16.995874 (+ 134us) server_negotiation.cc:407] Connection header received
0810 06:41:16.995942 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:16.995943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:16.995956 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:16.996016 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:41:16.996620 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.997071 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.997827 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:16.998003 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:16.998059 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:16.999157 (+ 1098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:41:16.999159 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:41:16.999159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:41:16.999165 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:41:17.000515 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:41:17.000845 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:41:17.000846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:41:17.000846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:41:17.000895 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:41:17.001066 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:41:17.001066 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:41:17.001066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:41:17.001206 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:41:17.001282 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:17.001469 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 06:41:17.001528 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:41:17.003098 9209 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60172:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:41:17.004662 9209 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:41:17.011572 9790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:17.007390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57946 (local address 127.27.41.130:37979)
0810 06:41:17.007625 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:17.007630 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:17.007642 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:41:17.007689 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:17.007691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:17.007709 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:17.007786 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:41:17.008204 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.009412 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.010632 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.011165 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.011253 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:17.011310 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:17.011446 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 06:41:17.011486 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":129,"threads_started":1}
I20260810 06:41:17.011610 9789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:17.007269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:37979 (local address 127.0.0.1:57946)
0810 06:41:17.007576 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:17.007585 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:17.007623 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:17.007886 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:17.007889 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:17.007892 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:41:17.008110 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:17.008114 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.009541 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.009543 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:17.010540 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:17.010543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.011254 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.011255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:17.011333 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:17.011347 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 06:41:17.011419 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 06:41:17.011479 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":116,"thread_start_us":75,"threads_started":1}
I20260810 06:41:17.011798 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:17.007067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:36583 (local address 127.0.0.1:35470)
0810 06:41:17.007212 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:17.007252 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:17.007323 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:17.008203 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:17.008204 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:17.008206 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:41:17.008241 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:17.008242 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.009599 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.009601 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:17.010641 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:17.010644 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.011519 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.011519 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:17.011575 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:17.011580 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:41:17.011608 (+ 28us) client_negotiation.cc:240] Negotiation successful
0810 06:41:17.011641 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":82,"threads_started":1}
I20260810 06:41:17.011616 9786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:17.007067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:40489 (local address 127.0.0.1:60786)
0810 06:41:17.007400 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:17.007411 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:17.007455 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:17.007925 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:17.007927 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:17.007928 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:41:17.008108 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:17.008110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.009091 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.009092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:17.010327 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:17.010330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.011330 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.011331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:17.011394 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:17.011399 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:41:17.011452 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 06:41:17.011511 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"mutex_wait_us":130,"thread_start_us":62,"threads_started":1}
I20260810 06:41:17.012053 9788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:17.007214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60786 (local address 127.27.41.131:40489)
0810 06:41:17.007745 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:17.007749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:17.007758 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:41:17.007793 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:17.007795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:17.007810 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:17.007887 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:41:17.008193 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.008979 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.010421 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.011172 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.011240 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:17.011294 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:17.011767 (+ 473us) server_negotiation.cc:299] Negotiation successful
0810 06:41:17.011835 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":102,"threads_started":1}
I20260810 06:41:17.012166 9791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:17.007424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35470 (local address 127.27.41.129:36583)
0810 06:41:17.008026 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:17.008031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:17.008041 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:41:17.008082 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:17.008084 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:17.008100 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:17.008315 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:41:17.008397 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.009482 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.010714 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.011418 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.011921 (+ 503us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:17.011992 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:17.012024 (+ 32us) server_negotiation.cc:299] Negotiation successful
0810 06:41:17.012071 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":118,"threads_started":1}
I20260810 06:41:17.012689 9686 tablet_service.cc:1467] Processing CreateTablet for tablet 511086c82feb4ab7b7fa387fdcdf4ee3 (DEFAULT_TABLE table=test-table [id=fce066ab9e31451d8113628235452349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:41:17.012845 9365 tablet_service.cc:1467] Processing CreateTablet for tablet 511086c82feb4ab7b7fa387fdcdf4ee3 (DEFAULT_TABLE table=test-table [id=fce066ab9e31451d8113628235452349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:41:17.013075 9686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511086c82feb4ab7b7fa387fdcdf4ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:41:17.013284 9365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511086c82feb4ab7b7fa387fdcdf4ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:41:17.016007 9792 tablet_bootstrap.cc:492] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a: Bootstrap starting.
I20260810 06:41:17.016443 9793 tablet_bootstrap.cc:492] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d: Bootstrap starting.
I20260810 06:41:17.016611 9523 tablet_service.cc:1467] Processing CreateTablet for tablet 511086c82feb4ab7b7fa387fdcdf4ee3 (DEFAULT_TABLE table=test-table [id=fce066ab9e31451d8113628235452349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:41:17.016753 9792 tablet_bootstrap.cc:654] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a: Neither blocks nor log segments found. Creating new log.
I20260810 06:41:17.016968 9523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511086c82feb4ab7b7fa387fdcdf4ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:41:17.017163 9793 tablet_bootstrap.cc:654] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d: Neither blocks nor log segments found. Creating new log.
I20260810 06:41:17.017453 9792 log.cc:824] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:41:17.017830 9793 log.cc:824] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d: Log is configured to *not* fsync() on all Append() calls
I20260810 06:41:17.018304 9792 tablet_bootstrap.cc:492] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a: No bootstrap required, opened a new log
I20260810 06:41:17.018383 9792 ts_tablet_manager.cc:1397] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 06:41:17.019033 9793 tablet_bootstrap.cc:492] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d: No bootstrap required, opened a new log
I20260810 06:41:17.019106 9793 ts_tablet_manager.cc:1397] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260810 06:41:17.020001 9792 raft_consensus.cc:348] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "effae9527f174bf58a09238f1c92d25a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40489 } } peers { permanent_uuid: "02612598dd634637bf9625df816eb47f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37979 } } peers { permanent_uuid: "394315f42b7940ff8037686c0270494d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36583 } }
I20260810 06:41:17.020152 9792 raft_consensus.cc:374] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:41:17.020215 9792 raft_consensus.cc:729] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: effae9527f174bf58a09238f1c92d25a, State: Initialized, Role: FOLLOWER
I20260810 06:41:17.020498 9792 consensus_queue.cc:260] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "effae9527f174bf58a09238f1c92d25a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40489 } } peers { permanent_uuid: "02612598dd634637bf9625df816eb47f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37979 } } peers { permanent_uuid: "394315f42b7940ff8037686c0270494d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36583 } }
I20260810 06:41:17.020826 9792 ts_tablet_manager.cc:1428] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 06:41:17.020865 9770 heartbeater.cc:503] Master 127.27.41.190:42743 was elected leader, sending a full tablet report...
I20260810 06:41:17.021060 9793 raft_consensus.cc:348] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "effae9527f174bf58a09238f1c92d25a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40489 } } peers { permanent_uuid: "02612598dd634637bf9625df816eb47f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37979 } } peers { permanent_uuid: "394315f42b7940ff8037686c0270494d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36583 } }
I20260810 06:41:17.021263 9793 raft_consensus.cc:374] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:41:17.021312 9793 raft_consensus.cc:729] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 394315f42b7940ff8037686c0270494d, State: Initialized, Role: FOLLOWER
I20260810 06:41:17.021488 9798 tablet_bootstrap.cc:492] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f: Bootstrap starting.
I20260810 06:41:17.021469 9793 consensus_queue.cc:260] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "effae9527f174bf58a09238f1c92d25a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40489 } } peers { permanent_uuid: "02612598dd634637bf9625df816eb47f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37979 } } peers { permanent_uuid: "394315f42b7940ff8037686c0270494d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36583 } }
I20260810 06:41:17.021750 9793 ts_tablet_manager.cc:1428] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:41:17.021910 9440 heartbeater.cc:503] Master 127.27.41.190:42743 was elected leader, sending a full tablet report...
I20260810 06:41:17.022212 9798 tablet_bootstrap.cc:654] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f: Neither blocks nor log segments found. Creating new log.
I20260810 06:41:17.022811 9798 log.cc:824] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f: Log is configured to *not* fsync() on all Append() calls
I20260810 06:41:17.023741 9798 tablet_bootstrap.cc:492] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f: No bootstrap required, opened a new log
I20260810 06:41:17.023793 9798 ts_tablet_manager.cc:1397] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:41:17.025292 9798 raft_consensus.cc:348] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "effae9527f174bf58a09238f1c92d25a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40489 } } peers { permanent_uuid: "02612598dd634637bf9625df816eb47f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37979 } } peers { permanent_uuid: "394315f42b7940ff8037686c0270494d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36583 } }
I20260810 06:41:17.025466 9798 raft_consensus.cc:374] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:41:17.025494 9798 raft_consensus.cc:729] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02612598dd634637bf9625df816eb47f, State: Initialized, Role: FOLLOWER
I20260810 06:41:17.025573 9798 consensus_queue.cc:260] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "effae9527f174bf58a09238f1c92d25a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40489 } } peers { permanent_uuid: "02612598dd634637bf9625df816eb47f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37979 } } peers { permanent_uuid: "394315f42b7940ff8037686c0270494d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36583 } }
I20260810 06:41:17.025763 9798 ts_tablet_manager.cc:1428] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:41:17.025835 9606 heartbeater.cc:503] Master 127.27.41.190:42743 was elected leader, sending a full tablet report...
W20260810 06:41:17.072928 9607 tablet.cc:2369] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:41:17.075307 9802 raft_consensus.cc:482] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:41:17.075457 9802 raft_consensus.cc:504] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "effae9527f174bf58a09238f1c92d25a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40489 } } peers { permanent_uuid: "02612598dd634637bf9625df816eb47f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37979 } } peers { permanent_uuid: "394315f42b7940ff8037686c0270494d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36583 } }
I20260810 06:41:17.075866 9802 leader_election.cc:288] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers effae9527f174bf58a09238f1c92d25a (127.27.41.131:40489), 394315f42b7940ff8037686c0270494d (127.27.41.129:36583)
I20260810 06:41:17.078977 9788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:17.076086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:32973 (local address 127.27.41.131:40489)
0810 06:41:17.076137 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:17.076140 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:17.076156 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:41:17.076256 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:17.076257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:17.076283 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:17.076355 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:41:17.076664 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.077136 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.078177 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.078591 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.078678 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:17.078688 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:17.078864 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 06:41:17.078905 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 06:41:17.079027 9608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:17.076022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:40489 (local address 127.27.41.130:32973)
0810 06:41:17.076111 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:17.076122 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:17.076168 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:17.076361 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:17.076363 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:17.076364 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:41:17.076437 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:17.076439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.077221 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.077222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:17.078076 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:17.078078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.078674 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.078675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:17.078759 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:17.078769 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 06:41:17.078854 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 06:41:17.078899 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260810 06:41:17.079021 9791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:17.076103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:60311 (local address 127.27.41.129:36583)
0810 06:41:17.076161 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:17.076163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:17.076525 (+ 362us) server_negotiation.cc:407] Connection header received
0810 06:41:17.076555 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:17.076556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:17.076570 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:17.076616 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:41:17.076792 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.077277 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.078254 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.078647 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.078731 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:17.078740 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:17.078899 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 06:41:17.078947 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 06:41:17.079054 9804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:17.076022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:36583 (local address 127.27.41.130:60311)
0810 06:41:17.076414 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:17.076430 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:41:17.076490 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:41:17.076632 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:41:17.076632 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:41:17.076634 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:41:17.076716 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:17.076717 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.077392 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.077393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:17.078143 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:41:17.078146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.078743 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.078744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:41:17.078825 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:17.078828 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:41:17.078893 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 06:41:17.078938 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":221,"thread_start_us":120,"threads_started":1}
I20260810 06:41:17.079469 9386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511086c82feb4ab7b7fa387fdcdf4ee3" candidate_uuid: "02612598dd634637bf9625df816eb47f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "394315f42b7940ff8037686c0270494d" is_pre_election: true
I20260810 06:41:17.079504 9710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511086c82feb4ab7b7fa387fdcdf4ee3" candidate_uuid: "02612598dd634637bf9625df816eb47f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "effae9527f174bf58a09238f1c92d25a" is_pre_election: true
I20260810 06:41:17.079643 9386 raft_consensus.cc:2454] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02612598dd634637bf9625df816eb47f in term 0.
I20260810 06:41:17.079656 9710 raft_consensus.cc:2454] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02612598dd634637bf9625df816eb47f in term 0.
I20260810 06:41:17.079885 9464 leader_election.cc:302] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02612598dd634637bf9625df816eb47f, effae9527f174bf58a09238f1c92d25a; no voters:
I20260810 06:41:17.080029 9802 raft_consensus.cc:2781] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:41:17.080087 9802 raft_consensus.cc:482] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:41:17.080123 9802 raft_consensus.cc:3037] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:41:17.080864 9802 raft_consensus.cc:504] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "effae9527f174bf58a09238f1c92d25a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40489 } } peers { permanent_uuid: "02612598dd634637bf9625df816eb47f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37979 } } peers { permanent_uuid: "394315f42b7940ff8037686c0270494d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36583 } }
I20260810 06:41:17.081019 9802 leader_election.cc:288] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [CANDIDATE]: Term 1 election: Requested vote from peers effae9527f174bf58a09238f1c92d25a (127.27.41.131:40489), 394315f42b7940ff8037686c0270494d (127.27.41.129:36583)
I20260810 06:41:17.081207 9710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511086c82feb4ab7b7fa387fdcdf4ee3" candidate_uuid: "02612598dd634637bf9625df816eb47f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "effae9527f174bf58a09238f1c92d25a"
I20260810 06:41:17.081240 9386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "511086c82feb4ab7b7fa387fdcdf4ee3" candidate_uuid: "02612598dd634637bf9625df816eb47f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "394315f42b7940ff8037686c0270494d"
I20260810 06:41:17.081303 9710 raft_consensus.cc:3037] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:41:17.081338 9386 raft_consensus.cc:3037] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:41:17.082110 9710 raft_consensus.cc:2454] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02612598dd634637bf9625df816eb47f in term 1.
I20260810 06:41:17.082187 9386 raft_consensus.cc:2454] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02612598dd634637bf9625df816eb47f in term 1.
I20260810 06:41:17.082333 9464 leader_election.cc:302] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02612598dd634637bf9625df816eb47f, effae9527f174bf58a09238f1c92d25a; no voters:
I20260810 06:41:17.082427 9802 raft_consensus.cc:2781] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:41:17.082631 9802 raft_consensus.cc:686] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [term 1 LEADER]: Becoming Leader. State: Replica: 02612598dd634637bf9625df816eb47f, State: Running, Role: LEADER
I20260810 06:41:17.082718 9802 consensus_queue.cc:237] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "effae9527f174bf58a09238f1c92d25a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40489 } } peers { permanent_uuid: "02612598dd634637bf9625df816eb47f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37979 } } peers { permanent_uuid: "394315f42b7940ff8037686c0270494d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36583 } }
I20260810 06:41:17.083560 9208 catalog_manager.cc:5495] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f reported cstate change: term changed from 0 to 1, leader changed from <none> to 02612598dd634637bf9625df816eb47f (127.27.41.130). New cstate: current_term: 1 leader_uuid: "02612598dd634637bf9625df816eb47f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "effae9527f174bf58a09238f1c92d25a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02612598dd634637bf9625df816eb47f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "394315f42b7940ff8037686c0270494d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36583 } health_report { overall_health: UNKNOWN } } }
I20260810 06:41:17.103111 9790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:17.100704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57962 (local address 127.27.41.130:37979)
0810 06:41:17.100767 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 06:41:17.100769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:41:17.100797 (+ 28us) server_negotiation.cc:407] Connection header received
0810 06:41:17.100828 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:41:17.100829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:41:17.100846 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:41:17.100899 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:41:17.101052 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.101587 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.102380 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:41:17.102568 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:41:17.102616 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:41:17.102766 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:41:17.102863 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:41:17.102922 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 06:41:17.102978 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 06:41:17.102994 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 06:41:17.104873 9386 raft_consensus.cc:1261] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 394315f42b7940ff8037686c0270494d [term 1 FOLLOWER]: Refusing update from remote peer 02612598dd634637bf9625df816eb47f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:41:17.104921 9710 raft_consensus.cc:1261] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a [term 1 FOLLOWER]: Refusing update from remote peer 02612598dd634637bf9625df816eb47f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:41:17.105252 9802 consensus_queue.cc:1035] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [LEADER]: Connected to new peer: Peer: permanent_uuid: "effae9527f174bf58a09238f1c92d25a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 40489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:41:17.105445 9805 consensus_queue.cc:1035] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [LEADER]: Connected to new peer: Peer: permanent_uuid: "394315f42b7940ff8037686c0270494d" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 36583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:41:17.108644 9809 mvcc.cc:205] Tried to move back new op lower bound from 7316865339818749952 to 7316865339731501056. Current Snapshot: MvccSnapshot[applied={T|T < 7316865339818749952}]
I20260810 06:41:17.109781 9811 mvcc.cc:205] Tried to move back new op lower bound from 7316865339818749952 to 7316865339731501056. Current Snapshot: MvccSnapshot[applied={T|T < 7316865339818749952 or (T in {7316865339818749952})}]
I20260810 06:41:17.111168 9209 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:41:17.111279 9209 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:41:17.112100 9209 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 400a5b6227b9490b8e2b4cb8a8816908: Sending DeleteTablet for 3 replicas of tablet 511086c82feb4ab7b7fa387fdcdf4ee3
I20260810 06:41:17.112471 9365 tablet_service.cc:1514] Processing DeleteTablet for tablet 511086c82feb4ab7b7fa387fdcdf4ee3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:41:17 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:35470
I20260810 06:41:17.112473 9686 tablet_service.cc:1514] Processing DeleteTablet for tablet 511086c82feb4ab7b7fa387fdcdf4ee3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:41:17 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:60786
I20260810 06:41:17.112851 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 9286
I20260810 06:41:17.112866 9822 tablet_replica.cc:330] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a: stopping tablet replica
I20260810 06:41:17.112884 9523 tablet_service.cc:1514] Processing DeleteTablet for tablet 511086c82feb4ab7b7fa387fdcdf4ee3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:41:17 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:57946
I20260810 06:41:17.127837 9825 tablet_replica.cc:330] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f: stopping tablet replica
I20260810 06:41:17.127993 9825 raft_consensus.cc:2229] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:41:17.128121 9825 raft_consensus.cc:2258] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:41:17.128355 9822 raft_consensus.cc:2229] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:41:17.128551 9822 raft_consensus.cc:2258] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:41:17.129240 9822 ts_tablet_manager.cc:1905] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:41:17.129243 9825 ts_tablet_manager.cc:1905] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:41:17.131366 9825 ts_tablet_manager.cc:1918] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:41:17.131489 9825 log.cc:1196] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/511086c82feb4ab7b7fa387fdcdf4ee3
I20260810 06:41:17.131583 9822 ts_tablet_manager.cc:1918] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:41:17.131750 9822 log.cc:1196] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/511086c82feb4ab7b7fa387fdcdf4ee3
I20260810 06:41:17.131879 9825 ts_tablet_manager.cc:1939] T 511086c82feb4ab7b7fa387fdcdf4ee3 P 02612598dd634637bf9625df816eb47f: Deleting consensus metadata
I20260810 06:41:17.132146 9822 ts_tablet_manager.cc:1939] T 511086c82feb4ab7b7fa387fdcdf4ee3 P effae9527f174bf58a09238f1c92d25a: Deleting consensus metadata
I20260810 06:41:17.132414 9192 catalog_manager.cc:4841] TS 02612598dd634637bf9625df816eb47f (127.27.41.130:37979): tablet 511086c82feb4ab7b7fa387fdcdf4ee3 (table test-table [id=fce066ab9e31451d8113628235452349]) successfully deleted
I20260810 06:41:17.132671 9192 catalog_manager.cc:4841] TS effae9527f174bf58a09238f1c92d25a (127.27.41.131:40489): tablet 511086c82feb4ab7b7fa387fdcdf4ee3 (table test-table [id=fce066ab9e31451d8113628235452349]) successfully deleted
W20260810 06:41:17.133739 9194 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:36583 (error 108)
I20260810 06:41:17.134017 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 9446
I20260810 06:41:17.137180 9789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:41:17.134151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:36583 (local address 127.0.0.1:35480)
0810 06:41:17.137091 (+ 2940us) negotiation.cc:107] Waiting for socket to connect
0810 06:41:17.137142 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:36583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2913}
W20260810 06:41:17.137403 9194 catalog_manager.cc:4584] TS 394315f42b7940ff8037686c0270494d (127.27.41.129:36583): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 511086c82feb4ab7b7fa387fdcdf4ee3: Network error: Client connection negotiation failed: client connection to 127.27.41.129:36583: connect: Connection refused (error 111)
I20260810 06:41:17.147961 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 9611
I20260810 06:41:17.158124 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 9169
2026-08-10T06:41:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2178 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:41:17 dist-test-slave-bw88 krb5kdc[9834](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:41:17 dist-test-slave-bw88 krb5kdc[9834](info): set up 2 sockets
Aug 10 06:41:17 dist-test-slave-bw88 krb5kdc[9834](info): commencing operation
krb5kdc: starting...
W20260810 06:41:18.353695 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:41:18 dist-test-slave-bw88 krb5kdc[9834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:41:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:41:18Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.27.41.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.27.41.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/rangeradmin_127.27.41.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/rangeradmin_127.27.41.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.27.41.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.27.41.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/rangerlookup_127.27.41.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/rangerlookup_127.27.41.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.41.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.27.41.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/HTTP_127.27.41.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/HTTP_127.27.41.148@KRBTEST.COM.keytab.
I20260810 06:41:18.525868 27814 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskyPrKbq/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/postgres -l logfile start
2026-08-10 06:41:21.116 UTC [9867] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 06:41:21.116 UTC [9867] LOG: listening on IPv4 address "127.27.41.148", port 43999
2026-08-10 06:41:21.120 UTC [9867] LOG: listening on Unix socket "/tmp/.s.PGSQL.43999"
2026-08-10 06:41:21.156 UTC [9872] LOG: database system was shut down at 2026-08-10 06:41:19 UTC
2026-08-10 06:41:21.161 UTC [9867] LOG: database system is ready to accept connections
I20260810 06:41:22.245558 27814 mini_postgres.cc:96] Postgres bound to 43999
2026-08-10 06:41:22.254 UTC [9882] FATAL: database "slave" does not exist
127.27.41.148:43999 - accepting connections
I20260810 06:41:22.255347 27814 mini_ranger.cc:161] Starting Ranger...
I20260810 06:41:22.272104 27814 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 06:41:22.747373 27814 mini_ranger.cc:87] Created ranger Postgres database
I20260810 06:41:22.747466 27814 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-admin
2026-08-10 06:41:23,065 [I] DB FLAVOR :POSTGRES
2026-08-10 06:41:23,066 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 06:41:23,066 [I] Checking connection..
2026-08-10 06:41:23,066 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 06:41:23,308 [I] Checking connection passed.
2026-08-10 06:41:23,308 [I] --------- Verifying version history table ---------
2026-08-10 06:41:23,308 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 06:41:23,567 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 06:41:23,568 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 06:41:23,837 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 06:41:23,838 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 06:41:23,838 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 06:41:24.085 UTC [9976] WARNING: there is no transaction in progress
2026-08-10 06:41:24,094 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 06:41:24,094 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 06:41:24,360 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 06:41:24,361 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 06:41:24,361 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 06:41:24,615 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 06:41:24,858 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-bw88.c.gcp-upstream.internal','N') ;"
2026-08-10 06:41:25,119 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 06:41:25,385 [I] Table x_portal_user does not exist in database ranger
2026-08-10 06:41:25,386 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 06:41:25,620 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 06:41:25,621 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 06:41:25,879 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 06:41:26,116 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 06:41:26,116 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 06:41:27.099 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.115 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.131 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.148 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.165 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.183 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.237 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.244 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.258 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.268 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.278 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.292 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.301 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.307 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.313 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27.320 UTC [10133] WARNING: there is no transaction in progress
2026-08-10 06:41:27,942 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 06:41:27,942 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 06:41:28,199 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 06:41:28,200 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 06:41:28,463 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 06:41:28,463 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 06:41:28,725 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 06:41:28,726 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 06:41:28,963 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 06:41:29,221 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-bw88.c.gcp-upstream.internal';"
2026-08-10 06:41:29,474 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 06:41:29,474 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 06:41:29,768 [I] DB_PATCHES have already been applied
I20260810 06:41:29.774811 27814 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-admin:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskyPrKbq/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 06:41:29.774876 27814 mini_ranger.cc:193] Using host: 127.27.41.148
I20260810 06:41:29.778844 27814 mini_ranger.cc:227] Ranger admin URL: http://127.27.41.148:41487
Aug 10, 2026 6:41:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 6:41:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 6:41:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 6:41:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 6:41:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 6:41:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 6:41:30 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 06:41:31.110414 27814 mini_ranger.cc:160] Time spent starting Ranger: real 8.855s user 0.001s sys 0.010s
Aug 10, 2026 6:41:52 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 6:41:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 10, 2026 6:41:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 6:41:52 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 6:41:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 6:41:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 6:41:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 6:41:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 6:41:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 6:41:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 6:41:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 6:41:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 6:41:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 6:41:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 6:41:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 6:41:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 6:41:52 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 6:41:53 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 06:41:53.924764 27814 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.27.41.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.27.41.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/rangerkms_127.27.41.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/rangerkms_127.27.41.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.41.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.27.41.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.41.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/HTTP_127.27.41.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.41.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/HTTP_127.27.41.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 06:41:54 dist-test-slave-bw88 krb5kdc[9834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344114, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 06:41:54.007557 27814 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 06:41:54.017629 27814 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 06:41:54.789453 27814 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 06:41:54.789548 27814 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-kms
I20260810 06:41:54.789572 27814 mini_ranger_kms.cc:227] Using postgres at 127.27.41.148:43999
2026-08-10 06:41:55,487 [I] DB FLAVOR :POSTGRES
2026-08-10 06:41:55,487 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 06:41:55,487 [I] Checking connection
2026-08-10 06:41:55,488 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 06:41:55,747 [I] connection success
2026-08-10 06:41:55,747 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 06:41:55,747 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 06:41:55,747 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 06:41:55,984 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 06:41:55,984 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 06:41:55,985 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 06:41:55,985 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:43999/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 06:41:56,257 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 06:41:56.723932 27814 mini_ranger_kms.cc:310] Created kms service
I20260810 06:41:56.972867 27814 mini_ranger_kms.cc:326] Created kudu user
I20260810 06:41:57.022354 27814 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 06:41:57 dist-test-slave-bw88 krb5kdc[9834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344114, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:41:57.467697 27814 mini_ranger_kms.cc:384] Added ranger policy
I20260810 06:41:57.467828 27814 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-kms:/tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 06:41:57.467852 27814 mini_ranger_kms.cc:240] Using host: 127.27.41.148
I20260810 06:41:57.471988 27814 mini_ranger_kms.cc:276] Ranger KMS PID: 10367
I20260810 06:41:57.472126 27814 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.27.41.148:47869
Aug 10, 2026 6:41:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 6:41:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 6:41:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 6:41:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 6:41:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 6:41:58 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 06:41:59 dist-test-slave-bw88 krb5kdc[9834](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786344119, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.41.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 10 06:42:00 dist-test-slave-bw88 krb5kdc[9834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344119, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.41.148@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:00.123984 27814 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.116s user 0.000s sys 0.628s
I20260810 06:42:00.124096 27814 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 06:42:00.124173 27814 mini_ranger_kms.cc:401] 127.27.41.148:47869/kms/v1/keys
Aug 10 06:42:00 dist-test-slave-bw88 krb5kdc[9834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344119, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.41.148@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
Aug 10 06:42:02 dist-test-slave-bw88 krb5kdc[9834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:42:02.845045 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38761
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:38761
--ranger_config_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.41.148:47869/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:42:02.929981 10436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:02.930256 10436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:02.930279 10436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:02.931452 10436 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:42:02.931496 10436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:02.931510 10436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:02.931526 10436 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:42:02.931538 10436 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:42:02.933188 10436 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/wal
--ranger_kms_url=127.27.41.148:47869/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:38761
--ranger_config_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:02.933461 10436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:02.933706 10436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:42:02.938947 10436 server_base.cc:1034] running on GCE node
W20260810 06:42:02.939052 10445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:02.939004 10444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:02.939149 10448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:02.939450 10436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:02.939764 10436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:02.940930 10436 hybrid_clock.cc:648] HybridClock initialized: now 1786344122940907 us; error 41 us; skew 500 ppm
Aug 10 06:42:02 dist-test-slave-bw88 krb5kdc[9834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344122, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:02.943797 10436 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:42:02.944332 10436 webserver.cc:460] Webserver started at http://127.27.41.190:44657/ using document root <none> and password file <none>
I20260810 06:42:02.944603 10436 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:02.944674 10436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:42:02.944825 10436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:42:02 dist-test-slave-bw88 krb5kdc[9834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344122, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:02.991838 10436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "0efd6debbb6345e782c2091031ad183b"
format_stamp: "Formatted at 2026-08-10 06:42:02 on dist-test-slave-bw88"
server_key: "d5d5611618ad04de35edd41dd654b4fe"
server_key_iv: "d73b2aa7ee2c6f2c183cb878debc2591"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:02.992267 10436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "0efd6debbb6345e782c2091031ad183b"
format_stamp: "Formatted at 2026-08-10 06:42:02 on dist-test-slave-bw88"
server_key: "d5d5611618ad04de35edd41dd654b4fe"
server_key_iv: "d73b2aa7ee2c6f2c183cb878debc2591"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:02.993875 10436 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:42:03.010452 10459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:03.010703 10436 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 06:42:03.010835 10436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "0efd6debbb6345e782c2091031ad183b"
format_stamp: "Formatted at 2026-08-10 06:42:02 on dist-test-slave-bw88"
server_key: "d5d5611618ad04de35edd41dd654b4fe"
server_key_iv: "d73b2aa7ee2c6f2c183cb878debc2591"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:03.010948 10436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:03.062949 10436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:03.065089 10436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:03.065265 10436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:03.070521 10436 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:38761
I20260810 06:42:03.070542 10534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:38761 every 8 connection(s)
I20260810 06:42:03.070940 10436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:42:03.071802 10535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:42:03.072256 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 10436
I20260810 06:42:03.072384 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:42:03.072611 27814 external_mini_cluster.cc:1428] Setting key ffff4b3c32872ef41fc7fe37fc7e9ed4
I20260810 06:42:03.075165 10535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b: Bootstrap starting.
I20260810 06:42:03.075914 10535 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b: Neither blocks nor log segments found. Creating new log.
I20260810 06:42:03.076249 10535 log.cc:824] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b: Log is configured to *not* fsync() on all Append() calls
I20260810 06:42:03.077768 10535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b: No bootstrap required, opened a new log
Aug 10 06:42:03 dist-test-slave-bw88 krb5kdc[9834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:42:03.080240 10535 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efd6debbb6345e782c2091031ad183b" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38761 } }
I20260810 06:42:03.080412 10535 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:42:03.080475 10535 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efd6debbb6345e782c2091031ad183b, State: Initialized, Role: FOLLOWER
I20260810 06:42:03.080622 10535 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efd6debbb6345e782c2091031ad183b" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38761 } }
I20260810 06:42:03.080714 10535 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:42:03.080796 10535 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:42:03.080886 10535 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:42:03.081681 10535 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efd6debbb6345e782c2091031ad183b" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38761 } }
I20260810 06:42:03.081820 10535 leader_election.cc:302] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0efd6debbb6345e782c2091031ad183b; no voters:
I20260810 06:42:03.082032 10535 leader_election.cc:288] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:42:03.082099 10541 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:42:03.082341 10541 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [term 1 LEADER]: Becoming Leader. State: Replica: 0efd6debbb6345e782c2091031ad183b, State: Running, Role: LEADER
I20260810 06:42:03.082379 10535 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:42:03.082479 10541 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efd6debbb6345e782c2091031ad183b" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38761 } }
I20260810 06:42:03.083571 10541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0efd6debbb6345e782c2091031ad183b. Latest consensus state: current_term: 1 leader_uuid: "0efd6debbb6345e782c2091031ad183b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efd6debbb6345e782c2091031ad183b" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38761 } } }
I20260810 06:42:03.083668 10541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [sys.catalog]: This master's current role is: LEADER
I20260810 06:42:03.083913 10545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0efd6debbb6345e782c2091031ad183b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efd6debbb6345e782c2091031ad183b" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38761 } } }
I20260810 06:42:03.084057 10545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b [sys.catalog]: This master's current role is: LEADER
I20260810 06:42:03.084221 10535 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 06:42:03.084781 10561 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:42:03.085326 10561 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:42:03.089998 10538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:03.073186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54258 (local address 127.27.41.190:38761)
0810 06:42:03.073440 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:03.073456 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:03.073480 (+ 24us) server_negotiation.cc:407] Connection header received
0810 06:42:03.073900 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:03.073907 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:03.073952 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:03.074113 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:03.074804 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:03.075762 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:03.076841 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:03.077522 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:03.077658 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:03.080679 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:03.080682 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:03.080683 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:03.080695 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:03.082843 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:03.083330 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:03.083333 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:03.083334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:03.083431 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:03.083784 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:03.083786 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:03.083786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:03.084120 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:03.084275 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:03.089441 (+ 5166us) server_negotiation.cc:299] Negotiation successful
0810 06:42:03.089577 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":76,"threads_started":1}
I20260810 06:42:03.098240 10561 catalog_manager.cc:1347] Generated new cluster ID: 88b72dd9263e4c46b7c24b9e608f150a
I20260810 06:42:03.098335 10561 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:42:03.104570 10561 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:42:03.105336 10561 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:42:03.108747 10561 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b: Generated new TSK 0
I20260810 06:42:03.108922 10561 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:42:03.780442 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.41.148:47869/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38761
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:42:03.872056 10593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:03.872284 10593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:03.872324 10593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:03.873541 10593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:03.873605 10593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:03.873649 10593 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:42:03.875226 10593 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.27.41.148:47869/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:03.875501 10593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:03.875763 10593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:03.880937 10599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:03.880962 10598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:03.881235 10601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:03.881304 10593 server_base.cc:1034] running on GCE node
I20260810 06:42:03.881526 10593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:03.881771 10593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:03.882969 10593 hybrid_clock.cc:648] HybridClock initialized: now 1786344123882952 us; error 33 us; skew 500 ppm
Aug 10 06:42:03 dist-test-slave-bw88 krb5kdc[9834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344123, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:03.885892 10593 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:42:03.886363 10593 webserver.cc:460] Webserver started at http://127.27.41.129:36671/ using document root <none> and password file <none>
I20260810 06:42:03.886637 10593 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:03.886706 10593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:42:03.886878 10593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:42:03 dist-test-slave-bw88 krb5kdc[9834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344123, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:03.899989 10593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "f4ff225fcaf94ca38cca328fd345bd3a"
format_stamp: "Formatted at 2026-08-10 06:42:03 on dist-test-slave-bw88"
server_key: "584c0dd82ad69b6897ce5c6774113c47"
server_key_iv: "d7ae396ba4cc2ede60fba283dc687be3"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:03.900560 10593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "f4ff225fcaf94ca38cca328fd345bd3a"
format_stamp: "Formatted at 2026-08-10 06:42:03 on dist-test-slave-bw88"
server_key: "584c0dd82ad69b6897ce5c6774113c47"
server_key_iv: "d7ae396ba4cc2ede60fba283dc687be3"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:03.902943 10593 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260810 06:42:03.918185 10611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:03.918417 10593 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:42:03.918521 10593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "f4ff225fcaf94ca38cca328fd345bd3a"
format_stamp: "Formatted at 2026-08-10 06:42:03 on dist-test-slave-bw88"
server_key: "584c0dd82ad69b6897ce5c6774113c47"
server_key_iv: "d7ae396ba4cc2ede60fba283dc687be3"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:03.918689 10593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:03.934608 10593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:03.937255 10593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:03.937517 10593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:03.937870 10593 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:42:03.938335 10593 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:42:03.938428 10593 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:03.938539 10593 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:42:03.938617 10593 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:03.946094 10593 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:37281
I20260810 06:42:03.946597 10593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:42:03.950096 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 10593
I20260810 06:42:03.950205 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:42:03.950413 27814 external_mini_cluster.cc:1428] Setting key 726627f200fcb142bde4764d5e3b166d
I20260810 06:42:03.949501 10757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:37281 every 8 connection(s)
Aug 10 06:42:03 dist-test-slave-bw88 krb5kdc[9834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344123, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
I20260810 06:42:03.968467 10765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:03.956570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:54943 (local address 127.27.41.190:38761)
0810 06:42:03.956702 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:03.956705 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:03.957618 (+ 913us) server_negotiation.cc:407] Connection header received
0810 06:42:03.958331 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:03.958332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:03.958347 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:03.958391 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:03.959260 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:03.960027 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:03.961596 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:03.961901 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:03.961948 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:03.964768 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:03.964770 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:03.964770 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:03.964779 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:03.966572 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:03.967133 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:03.967135 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:03.967135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:03.967208 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:03.967645 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:03.967646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:03.967646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:03.967802 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:03.967855 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:03.968274 (+ 419us) server_negotiation.cc:299] Negotiation successful
0810 06:42:03.968366 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":77,"threads_started":1}
I20260810 06:42:03.968688 10764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:03.956243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38761 (local address 127.27.41.129:54943)
0810 06:42:03.957473 (+ 1230us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:03.957532 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:03.958199 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:03.958601 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:03.958606 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:03.958852 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:03.959129 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:03.959136 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:03.960150 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:03.960151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:03.961487 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:03.961490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:03.962056 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:03.962057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:03.962204 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:03.962867 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:03.962878 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:03.964649 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:03.966710 (+ 2061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:03.966716 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:03.966719 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:03.967037 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:03.967379 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:03.967380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:03.967381 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:03.967540 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:03.967913 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:03.967922 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:03.968109 (+ 187us) client_negotiation.cc:769] Sending connection context
0810 06:42:03.968249 (+ 140us) client_negotiation.cc:240] Negotiation successful
0810 06:42:03.968439 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1182,"thread_start_us":96,"threads_started":1}
I20260810 06:42:03.970187 10758 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38761
I20260810 06:42:03.970299 10758 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:03.970518 10758 heartbeater.cc:511] Master 127.27.41.190:38761 requested a full tablet report, sending...
I20260810 06:42:03.971133 10484 ts_manager.cc:194] Registered new tserver with Master: f4ff225fcaf94ca38cca328fd345bd3a (127.27.41.129:37281)
I20260810 06:42:03.972033 10484 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:54943
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:42:03.988493 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.41.148:47869/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38761
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:42:04.105130 10769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:04.105453 10769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:04.105490 10769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:04.107194 10769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:04.107252 10769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:04.107291 10769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:42:04.109499 10769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.27.41.148:47869/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:04.109755 10769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:04.110088 10769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:04.116868 10786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:04.117182 10769 server_base.cc:1034] running on GCE node
W20260810 06:42:04.117252 10782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:04.117491 10784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:04.120982 10769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:04.121308 10769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:04.122536 10769 hybrid_clock.cc:648] HybridClock initialized: now 1786344124122501 us; error 47 us; skew 500 ppm
Aug 10 06:42:04 dist-test-slave-bw88 krb5kdc[9834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344124, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:04.125862 10769 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:42:04.126398 10769 webserver.cc:460] Webserver started at http://127.27.41.130:34669/ using document root <none> and password file <none>
I20260810 06:42:04.126684 10769 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:04.126785 10769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:42:04.126926 10769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:42:04 dist-test-slave-bw88 krb5kdc[9834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344124, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
Aug 10 06:42:04 dist-test-slave-bw88 krb5kdc[9834](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786344124, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:04.149860 10769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0"
format_stamp: "Formatted at 2026-08-10 06:42:04 on dist-test-slave-bw88"
server_key: "0e456d536520b916b1dd1d526bb30f33"
server_key_iv: "8a96066cca6d0683c78771b5fe9c37a8"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:04.150354 10769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0"
format_stamp: "Formatted at 2026-08-10 06:42:04 on dist-test-slave-bw88"
server_key: "0e456d536520b916b1dd1d526bb30f33"
server_key_iv: "8a96066cca6d0683c78771b5fe9c37a8"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:04.153887 10769 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:42:04.172923 10796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:04.173166 10769 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:42:04.173280 10769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0"
format_stamp: "Formatted at 2026-08-10 06:42:04 on dist-test-slave-bw88"
server_key: "0e456d536520b916b1dd1d526bb30f33"
server_key_iv: "8a96066cca6d0683c78771b5fe9c37a8"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:04.173424 10769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:04.208071 10769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:04.210319 10769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:04.210513 10769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:04.210788 10769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:42:04.211151 10769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:42:04.211206 10769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:04.211241 10769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:42:04.211270 10769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:04.218711 10769 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:39497
I20260810 06:42:04.218786 10952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:39497 every 8 connection(s)
I20260810 06:42:04.219108 10769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
Aug 10 06:42:04 dist-test-slave-bw88 krb5kdc[9834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344124, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:42:04.228745 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 10769
I20260810 06:42:04.228868 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:42:04.229084 27814 external_mini_cluster.cc:1428] Setting key 246f47794f0a933c9bf7377841992519
I20260810 06:42:04.231278 10958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.219894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38761 (local address 127.27.41.130:58511)
0810 06:42:04.220638 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:04.220681 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:04.221281 (+ 600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:04.221607 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:04.221611 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:04.221798 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:04.222003 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.222007 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.223031 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.223043 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.224300 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.224304 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.224870 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.224872 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.225012 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.225642 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:04.225652 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:04.227330 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:04.229627 (+ 2297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:04.229634 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:04.229636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:04.229942 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:04.230173 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:04.230173 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:04.230174 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:04.230320 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:04.230630 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:04.230635 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:04.230789 (+ 154us) client_negotiation.cc:769] Sending connection context
0810 06:42:04.230894 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 06:42:04.231054 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":105,"threads_started":1}
I20260810 06:42:04.231726 10765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.219911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:58511 (local address 127.27.41.190:38761)
0810 06:42:04.219988 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:04.219991 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:04.220796 (+ 805us) server_negotiation.cc:407] Connection header received
0810 06:42:04.221448 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:04.221450 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:04.221467 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:04.221529 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:04.222103 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.222908 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.224400 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.224744 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.224837 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.227431 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:04.227432 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:04.227433 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:04.227441 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:04.229536 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:04.230043 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:04.230044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:04.230045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:04.230106 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:04.230393 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:04.230394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:04.230395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:04.230534 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:04.230604 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:04.231518 (+ 914us) server_negotiation.cc:299] Negotiation successful
0810 06:42:04.231618 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 06:42:04.232044 10956 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38761
I20260810 06:42:04.232134 10956 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:04.232308 10956 heartbeater.cc:511] Master 127.27.41.190:38761 requested a full tablet report, sending...
I20260810 06:42:04.232663 10484 ts_manager.cc:194] Registered new tserver with Master: 598aab4c95d4465ab9ee63d4b9ea2ce0 (127.27.41.130:39497)
I20260810 06:42:04.233191 10484 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:58511
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:42:04.264621 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.41.148:47869/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38761
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:42:04.357527 10966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:04.357741 10966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:04.357776 10966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:04.358925 10966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:04.358995 10966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:04.359046 10966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:42:04.360599 10966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.27.41.148:47869/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:04.360847 10966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:04.361099 10966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:04.366360 10972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:04.366374 10978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:04.366796 10973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:04.367040 10966 server_base.cc:1034] running on GCE node
I20260810 06:42:04.367226 10966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:04.367425 10966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:04.368567 10966 hybrid_clock.cc:648] HybridClock initialized: now 1786344124368555 us; error 26 us; skew 500 ppm
Aug 10 06:42:04 dist-test-slave-bw88 krb5kdc[9834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344124, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:04.371778 10966 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:42:04.372277 10966 webserver.cc:460] Webserver started at http://127.27.41.131:43825/ using document root <none> and password file <none>
I20260810 06:42:04.372519 10966 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:04.372591 10966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:42:04.372715 10966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:42:04 dist-test-slave-bw88 krb5kdc[9834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344124, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:04.389266 10966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "3bdc63070ef1460eaf76d11be4a46e99"
format_stamp: "Formatted at 2026-08-10 06:42:04 on dist-test-slave-bw88"
server_key: "cc982132257cbab24d4bd2135f01b3be"
server_key_iv: "a5d513ad8f3b819ebb6081b8451bdfff"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:04.389819 10966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "3bdc63070ef1460eaf76d11be4a46e99"
format_stamp: "Formatted at 2026-08-10 06:42:04 on dist-test-slave-bw88"
server_key: "cc982132257cbab24d4bd2135f01b3be"
server_key_iv: "a5d513ad8f3b819ebb6081b8451bdfff"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:04.395380 10966 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.000s
I20260810 06:42:04.417497 10986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:04.417727 10966 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260810 06:42:04.417845 10966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "3bdc63070ef1460eaf76d11be4a46e99"
format_stamp: "Formatted at 2026-08-10 06:42:04 on dist-test-slave-bw88"
server_key: "cc982132257cbab24d4bd2135f01b3be"
server_key_iv: "a5d513ad8f3b819ebb6081b8451bdfff"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:04.417968 10966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:04.435303 10966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:04.437491 10966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:04.437657 10966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:04.437940 10966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:42:04.438316 10966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:42:04.438372 10966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:04.438410 10966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:42:04.438458 10966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:04.446178 10966 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:45787
I20260810 06:42:04.446295 11149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:45787 every 8 connection(s)
I20260810 06:42:04.446630 10966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
Aug 10 06:42:04 dist-test-slave-bw88 krb5kdc[9834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344124, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:42:04.453594 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 10966
I20260810 06:42:04.453696 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:42:04.453869 27814 external_mini_cluster.cc:1428] Setting key e6b20b180f5690986761f839752b9994
I20260810 06:42:04.457541 10765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.447454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:34013 (local address 127.27.41.190:38761)
0810 06:42:04.447533 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:04.447535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:04.447731 (+ 196us) server_negotiation.cc:407] Connection header received
0810 06:42:04.448314 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:04.448316 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:04.448330 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:04.448394 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:04.448978 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.449567 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.450606 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.450816 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.450902 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.453233 (+ 2331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:04.453235 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:04.453235 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:04.453243 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:04.455879 (+ 2636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:04.456393 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:04.456394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:04.456395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:04.456456 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:04.456747 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:04.456748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:04.456748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:04.456886 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:04.456928 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:04.457298 (+ 370us) server_negotiation.cc:299] Negotiation successful
0810 06:42:04.457433 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 06:42:04.458060 11152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.447423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38761 (local address 127.27.41.131:34013)
0810 06:42:04.447612 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:04.447654 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:04.448192 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:04.448468 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:04.448472 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:04.448674 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:04.448869 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.448873 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.449661 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.449663 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.450481 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.450483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.450912 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.450913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.451051 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.451586 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:04.451595 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:04.453119 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:04.455983 (+ 2864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:04.455989 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:04.455992 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:04.456294 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:04.456527 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:04.456527 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:04.456528 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:04.456666 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:04.456975 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:04.456982 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:04.457142 (+ 160us) client_negotiation.cc:769] Sending connection context
0810 06:42:04.457661 (+ 519us) client_negotiation.cc:240] Negotiation successful
0810 06:42:04.457828 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":120,"threads_started":1}
I20260810 06:42:04.458472 11150 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38761
I20260810 06:42:04.458570 11150 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:04.458750 11150 heartbeater.cc:511] Master 127.27.41.190:38761 requested a full tablet report, sending...
I20260810 06:42:04.459084 10484 ts_manager.cc:194] Registered new tserver with Master: 3bdc63070ef1460eaf76d11be4a46e99 (127.27.41.131:45787)
I20260810 06:42:04.459586 10484 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:34013
I20260810 06:42:04.465895 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:42:04.476029 10765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.467581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54270 (local address 127.27.41.190:38761)
0810 06:42:04.467624 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:04.467626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:04.467895 (+ 269us) server_negotiation.cc:407] Connection header received
0810 06:42:04.468001 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:04.468002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:04.468013 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:04.468044 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:04.468902 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.469696 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.470945 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.471248 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.471331 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.472974 (+ 1643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:04.472976 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:04.472976 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:04.472984 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:04.474761 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:04.475161 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:04.475163 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:04.475163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:04.475229 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:04.475463 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:04.475464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:04.475465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:04.475601 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:04.475717 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:04.475862 (+ 145us) server_negotiation.cc:299] Negotiation successful
0810 06:42:04.475942 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:42:04.477855 10484 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54270:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:42:04.480275 10484 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:42:04.494813 11166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.488485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:39497 (local address 127.0.0.1:34292)
0810 06:42:04.488910 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:04.488958 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:04.489031 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:04.489534 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:04.489538 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:04.489541 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:42:04.489633 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.489635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.491317 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.491318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.492686 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.492690 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.494526 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.494527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.494616 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.494632 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 06:42:04.494681 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 06:42:04.494731 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":101,"threads_started":1}
I20260810 06:42:04.496889 11169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.489081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34292 (local address 127.27.41.130:39497)
0810 06:42:04.489279 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:04.489284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:04.489295 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:42:04.489367 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:04.489369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:04.489388 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:04.489719 (+ 331us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:42:04.489792 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.491218 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.492808 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.494386 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.496645 (+ 2259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.496740 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:04.496770 (+ 30us) server_negotiation.cc:299] Negotiation successful
0810 06:42:04.496811 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":87,"threads_started":1}
I20260810 06:42:04.497773 10856 tablet_service.cc:1467] Processing CreateTablet for tablet d7418da4b2b4477bb6fbfa5a280dc501 (DEFAULT_TABLE table=test-table [id=43c0b78279b44be5833a8f67abc84cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:42:04.498219 10856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7418da4b2b4477bb6fbfa5a280dc501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:42:04.500430 11166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.488727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:45787 (local address 127.0.0.1:36350)
0810 06:42:04.494906 (+ 6179us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:04.494916 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:04.494962 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:04.495496 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:04.495497 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:04.495499 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:42:04.495529 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.495530 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.497920 (+ 2390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.497921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.499193 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.499196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.500209 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.500210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.500272 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.500276 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:42:04.500308 (+ 32us) client_negotiation.cc:240] Negotiation successful
0810 06:42:04.500345 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6170,"thread_start_us":106,"threads_started":1}
I20260810 06:42:04.501080 11170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.489257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36350 (local address 127.27.41.131:45787)
0810 06:42:04.489470 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:04.489475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:04.495323 (+ 5848us) server_negotiation.cc:407] Connection header received
0810 06:42:04.495376 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:04.495378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:04.495395 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:04.495609 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:42:04.495683 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.496689 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.499326 (+ 2637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.500105 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.500843 (+ 738us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.500935 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:04.500962 (+ 27us) server_negotiation.cc:299] Negotiation successful
0810 06:42:04.501001 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":115,"threads_started":1}
I20260810 06:42:04.502470 11164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.488491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:37281 (local address 127.0.0.1:37558)
0810 06:42:04.489525 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:04.489544 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:04.489610 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:04.493079 (+ 3469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:04.493080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:04.493082 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:42:04.493129 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.493131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.494404 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.494405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.497798 (+ 3393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.497802 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.502239 (+ 4437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.502240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.502302 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.502306 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:42:04.502361 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 06:42:04.502400 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1017,"thread_start_us":104,"threads_started":1}
I20260810 06:42:04.502529 11171 tablet_bootstrap.cc:492] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0: Bootstrap starting.
I20260810 06:42:04.503388 11056 tablet_service.cc:1467] Processing CreateTablet for tablet d7418da4b2b4477bb6fbfa5a280dc501 (DEFAULT_TABLE table=test-table [id=43c0b78279b44be5833a8f67abc84cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:42:04.503614 11171 tablet_bootstrap.cc:654] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0: Neither blocks nor log segments found. Creating new log.
I20260810 06:42:04.503767 11056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7418da4b2b4477bb6fbfa5a280dc501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:42:04.503923 11171 log.cc:824] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0: Log is configured to *not* fsync() on all Append() calls
I20260810 06:42:04.507010 11175 tablet_bootstrap.cc:492] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99: Bootstrap starting.
I20260810 06:42:04.507390 11168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.488781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37558 (local address 127.27.41.129:37281)
0810 06:42:04.492864 (+ 4083us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:04.492868 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:04.492878 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:42:04.492914 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:04.492916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:04.492932 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:04.493006 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:42:04.493205 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.494304 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.501305 (+ 7001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.502070 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.502145 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.502199 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:04.507261 (+ 5062us) server_negotiation.cc:299] Negotiation successful
0810 06:42:04.507314 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4046,"thread_start_us":59,"threads_started":1}
I20260810 06:42:04.508113 10670 tablet_service.cc:1467] Processing CreateTablet for tablet d7418da4b2b4477bb6fbfa5a280dc501 (DEFAULT_TABLE table=test-table [id=43c0b78279b44be5833a8f67abc84cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:42:04.508447 10670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7418da4b2b4477bb6fbfa5a280dc501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:42:04.511073 11175 tablet_bootstrap.cc:654] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99: Neither blocks nor log segments found. Creating new log.
I20260810 06:42:04.511377 11175 log.cc:824] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99: Log is configured to *not* fsync() on all Append() calls
I20260810 06:42:04.512408 11177 tablet_bootstrap.cc:492] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a: Bootstrap starting.
I20260810 06:42:04.512550 11171 tablet_bootstrap.cc:492] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0: No bootstrap required, opened a new log
I20260810 06:42:04.512635 11171 ts_tablet_manager.cc:1397] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260810 06:42:04.513311 11177 tablet_bootstrap.cc:654] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a: Neither blocks nor log segments found. Creating new log.
I20260810 06:42:04.513743 11177 log.cc:824] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:42:04.514726 11175 tablet_bootstrap.cc:492] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99: No bootstrap required, opened a new log
I20260810 06:42:04.514850 11175 ts_tablet_manager.cc:1397] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260810 06:42:04.516158 11171 raft_consensus.cc:348] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ff225fcaf94ca38cca328fd345bd3a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37281 } } peers { permanent_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39497 } } peers { permanent_uuid: "3bdc63070ef1460eaf76d11be4a46e99" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45787 } }
I20260810 06:42:04.516333 11171 raft_consensus.cc:374] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:42:04.516379 11171 raft_consensus.cc:729] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598aab4c95d4465ab9ee63d4b9ea2ce0, State: Initialized, Role: FOLLOWER
I20260810 06:42:04.517072 11175 raft_consensus.cc:348] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ff225fcaf94ca38cca328fd345bd3a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37281 } } peers { permanent_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39497 } } peers { permanent_uuid: "3bdc63070ef1460eaf76d11be4a46e99" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45787 } }
I20260810 06:42:04.517298 11175 raft_consensus.cc:374] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:42:04.517421 11175 raft_consensus.cc:729] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bdc63070ef1460eaf76d11be4a46e99, State: Initialized, Role: FOLLOWER
I20260810 06:42:04.517604 11175 consensus_queue.cc:260] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ff225fcaf94ca38cca328fd345bd3a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37281 } } peers { permanent_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39497 } } peers { permanent_uuid: "3bdc63070ef1460eaf76d11be4a46e99" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45787 } }
I20260810 06:42:04.516553 11171 consensus_queue.cc:260] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ff225fcaf94ca38cca328fd345bd3a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37281 } } peers { permanent_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39497 } } peers { permanent_uuid: "3bdc63070ef1460eaf76d11be4a46e99" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45787 } }
I20260810 06:42:04.518039 11175 ts_tablet_manager.cc:1428] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:42:04.518141 11171 ts_tablet_manager.cc:1428] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260810 06:42:04.518216 11150 heartbeater.cc:503] Master 127.27.41.190:38761 was elected leader, sending a full tablet report...
I20260810 06:42:04.518273 10956 heartbeater.cc:503] Master 127.27.41.190:38761 was elected leader, sending a full tablet report...
I20260810 06:42:04.519309 11177 tablet_bootstrap.cc:492] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a: No bootstrap required, opened a new log
I20260810 06:42:04.519380 11177 ts_tablet_manager.cc:1397] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260810 06:42:04.522634 11177 raft_consensus.cc:348] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ff225fcaf94ca38cca328fd345bd3a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37281 } } peers { permanent_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39497 } } peers { permanent_uuid: "3bdc63070ef1460eaf76d11be4a46e99" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45787 } }
I20260810 06:42:04.522822 11177 raft_consensus.cc:374] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:42:04.522863 11177 raft_consensus.cc:729] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ff225fcaf94ca38cca328fd345bd3a, State: Initialized, Role: FOLLOWER
I20260810 06:42:04.522989 11177 consensus_queue.cc:260] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ff225fcaf94ca38cca328fd345bd3a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37281 } } peers { permanent_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39497 } } peers { permanent_uuid: "3bdc63070ef1460eaf76d11be4a46e99" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45787 } }
I20260810 06:42:04.523262 11177 ts_tablet_manager.cc:1428] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 06:42:04.523306 10758 heartbeater.cc:503] Master 127.27.41.190:38761 was elected leader, sending a full tablet report...
Aug 10 06:42:04 dist-test-slave-bw88 krb5kdc[9834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344124, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:04.620822 11182 raft_consensus.cc:482] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:42:04.620996 11182 raft_consensus.cc:504] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ff225fcaf94ca38cca328fd345bd3a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37281 } } peers { permanent_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39497 } } peers { permanent_uuid: "3bdc63070ef1460eaf76d11be4a46e99" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45787 } }
I20260810 06:42:04.621454 11182 leader_election.cc:288] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ff225fcaf94ca38cca328fd345bd3a (127.27.41.129:37281), 3bdc63070ef1460eaf76d11be4a46e99 (127.27.41.131:45787)
I20260810 06:42:04.625943 10958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.621681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:37281 (local address 127.27.41.130:53855)
0810 06:42:04.622023 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:04.622034 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:04.622078 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:04.622506 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:04.622507 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:04.622509 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:42:04.622596 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.622598 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.623552 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.623553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.624764 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.624767 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.625690 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.625692 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.625773 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.625777 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:42:04.625829 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 06:42:04.625870 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323}
I20260810 06:42:04.626551 11168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.622216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:53855 (local address 127.27.41.129:37281)
0810 06:42:04.622262 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:04.622264 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:04.622272 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:42:04.622301 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:04.622302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:04.622310 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:04.622355 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:42:04.622672 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.623454 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.624908 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.625557 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.625634 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.625644 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:04.626435 (+ 791us) server_negotiation.cc:299] Negotiation successful
0810 06:42:04.626483 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 06:42:04.626835 10700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7418da4b2b4477bb6fbfa5a280dc501" candidate_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ff225fcaf94ca38cca328fd345bd3a" is_pre_election: true
I20260810 06:42:04.627054 10700 raft_consensus.cc:2454] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 598aab4c95d4465ab9ee63d4b9ea2ce0 in term 0.
I20260810 06:42:04.627302 10798 leader_election.cc:302] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598aab4c95d4465ab9ee63d4b9ea2ce0, f4ff225fcaf94ca38cca328fd345bd3a; no voters:
I20260810 06:42:04.627399 11170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.622428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:51191 (local address 127.27.41.131:45787)
0810 06:42:04.622468 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:04.622470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:04.623834 (+ 1364us) server_negotiation.cc:407] Connection header received
0810 06:42:04.623968 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:04.623969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:04.623978 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:04.624006 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:42:04.624215 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.624961 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.626471 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.627036 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.627082 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.627089 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:04.627303 (+ 214us) server_negotiation.cc:299] Negotiation successful
0810 06:42:04.627336 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 06:42:04.627446 11182 raft_consensus.cc:2781] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:42:04.627499 11182 raft_consensus.cc:482] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:42:04.627522 11182 raft_consensus.cc:3037] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:42:04.627636 11186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.621817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:45787 (local address 127.27.41.130:51191)
0810 06:42:04.623654 (+ 1837us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:04.623665 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:04.623888 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:04.624064 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:04.624065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:04.624066 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:42:04.624142 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.624143 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.625074 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.625074 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.626380 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:04.626382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.627157 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.627158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:04.627230 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.627233 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:42:04.627499 (+ 266us) client_negotiation.cc:240] Negotiation successful
0810 06:42:04.627552 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1817,"thread_start_us":108,"threads_started":1}
I20260810 06:42:04.627944 11086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7418da4b2b4477bb6fbfa5a280dc501" candidate_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bdc63070ef1460eaf76d11be4a46e99" is_pre_election: true
I20260810 06:42:04.628072 11086 raft_consensus.cc:2454] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 598aab4c95d4465ab9ee63d4b9ea2ce0 in term 0.
I20260810 06:42:04.628458 11182 raft_consensus.cc:504] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ff225fcaf94ca38cca328fd345bd3a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37281 } } peers { permanent_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39497 } } peers { permanent_uuid: "3bdc63070ef1460eaf76d11be4a46e99" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45787 } }
I20260810 06:42:04.628594 11182 leader_election.cc:288] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [CANDIDATE]: Term 1 election: Requested vote from peers f4ff225fcaf94ca38cca328fd345bd3a (127.27.41.129:37281), 3bdc63070ef1460eaf76d11be4a46e99 (127.27.41.131:45787)
I20260810 06:42:04.628888 10700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7418da4b2b4477bb6fbfa5a280dc501" candidate_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ff225fcaf94ca38cca328fd345bd3a"
I20260810 06:42:04.628975 10700 raft_consensus.cc:3037] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:42:04.629925 10700 raft_consensus.cc:2454] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598aab4c95d4465ab9ee63d4b9ea2ce0 in term 1.
I20260810 06:42:04.630291 10798 leader_election.cc:302] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598aab4c95d4465ab9ee63d4b9ea2ce0, f4ff225fcaf94ca38cca328fd345bd3a; no voters:
I20260810 06:42:04.630431 11086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7418da4b2b4477bb6fbfa5a280dc501" candidate_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bdc63070ef1460eaf76d11be4a46e99"
I20260810 06:42:04.630508 11086 raft_consensus.cc:3037] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:42:04.631330 11086 raft_consensus.cc:2454] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598aab4c95d4465ab9ee63d4b9ea2ce0 in term 1.
I20260810 06:42:04.631543 11182 raft_consensus.cc:2781] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:42:04.631709 11182 raft_consensus.cc:686] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [term 1 LEADER]: Becoming Leader. State: Replica: 598aab4c95d4465ab9ee63d4b9ea2ce0, State: Running, Role: LEADER
I20260810 06:42:04.631836 11182 consensus_queue.cc:237] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ff225fcaf94ca38cca328fd345bd3a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37281 } } peers { permanent_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39497 } } peers { permanent_uuid: "3bdc63070ef1460eaf76d11be4a46e99" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45787 } }
I20260810 06:42:04.632607 10484 catalog_manager.cc:5495] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 598aab4c95d4465ab9ee63d4b9ea2ce0 (127.27.41.130). New cstate: current_term: 1 leader_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ff225fcaf94ca38cca328fd345bd3a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598aab4c95d4465ab9ee63d4b9ea2ce0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 39497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bdc63070ef1460eaf76d11be4a46e99" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45787 } health_report { overall_health: UNKNOWN } } }
I20260810 06:42:04.671873 11169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.668732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34304 (local address 127.27.41.130:39497)
0810 06:42:04.668787 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:04.668789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:04.668799 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:42:04.668883 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:04.668884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:04.668908 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:04.668992 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:42:04.669162 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.669896 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.670966 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:04.671265 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:04.671347 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:04.671513 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:42:04.671640 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:42:04.671728 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:04.671770 (+ 42us) server_negotiation.cc:299] Negotiation successful
0810 06:42:04.671792 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 06:42:04.673938 11086 raft_consensus.cc:1261] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99 [term 1 FOLLOWER]: Refusing update from remote peer 598aab4c95d4465ab9ee63d4b9ea2ce0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:42:04.674027 10700 raft_consensus.cc:1261] T d7418da4b2b4477bb6fbfa5a280dc501 P f4ff225fcaf94ca38cca328fd345bd3a [term 1 FOLLOWER]: Refusing update from remote peer 598aab4c95d4465ab9ee63d4b9ea2ce0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:42:04.674336 11189 consensus_queue.cc:1035] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bdc63070ef1460eaf76d11be4a46e99" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:42:04.674492 11182 consensus_queue.cc:1035] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ff225fcaf94ca38cca328fd345bd3a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:42:04.677117 11192 mvcc.cc:205] Tried to move back new op lower bound from 7316865534661681152 to 7316865534492446720. Current Snapshot: MvccSnapshot[applied={T|T < 7316865534661681152}]
I20260810 06:42:04.679682 10482 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:42:04.679790 10482 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:42:04.680612 10482 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0efd6debbb6345e782c2091031ad183b: Sending DeleteTablet for 3 replicas of tablet d7418da4b2b4477bb6fbfa5a280dc501
I20260810 06:42:04.680999 10856 tablet_service.cc:1514] Processing DeleteTablet for tablet d7418da4b2b4477bb6fbfa5a280dc501 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:42:04 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:34292
I20260810 06:42:04.681016 11056 tablet_service.cc:1514] Processing DeleteTablet for tablet d7418da4b2b4477bb6fbfa5a280dc501 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:42:04 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:36350
I20260810 06:42:04.681438 10670 tablet_service.cc:1514] Processing DeleteTablet for tablet d7418da4b2b4477bb6fbfa5a280dc501 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:42:04 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:37558
I20260810 06:42:04.682046 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 10593
I20260810 06:42:04.689445 11200 tablet_replica.cc:330] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0: stopping tablet replica
I20260810 06:42:04.689592 11200 raft_consensus.cc:2229] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:42:04.689685 11200 raft_consensus.cc:2258] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:42:04.691183 11194 mvcc.cc:205] Tried to move back new op lower bound from 7316865534661681152 to 7316865534492446720. Current Snapshot: MvccSnapshot[applied={T|T < 7316865534661681152}]
I20260810 06:42:04.691874 11201 tablet_replica.cc:330] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99: stopping tablet replica
I20260810 06:42:04.691949 11201 raft_consensus.cc:2229] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:42:04.692019 11201 raft_consensus.cc:2258] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:42:04.693819 11200 ts_tablet_manager.cc:1905] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:42:04.695887 11200 ts_tablet_manager.cc:1918] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:42:04.695969 11200 log.cc:1196] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/d7418da4b2b4477bb6fbfa5a280dc501
I20260810 06:42:04.696229 11200 ts_tablet_manager.cc:1939] T d7418da4b2b4477bb6fbfa5a280dc501 P 598aab4c95d4465ab9ee63d4b9ea2ce0: Deleting consensus metadata
I20260810 06:42:04.696693 10464 catalog_manager.cc:4841] TS 598aab4c95d4465ab9ee63d4b9ea2ce0 (127.27.41.130:39497): tablet d7418da4b2b4477bb6fbfa5a280dc501 (table test-table [id=43c0b78279b44be5833a8f67abc84cd9]) successfully deleted
W20260810 06:42:04.700385 10798 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:37281 (error 108)
W20260810 06:42:04.701112 10460 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:37281 (error 108)
I20260810 06:42:04.701467 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 10769
I20260810 06:42:04.704210 11164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:04.704093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:37281 (local address 127.0.0.1:37560)
0810 06:42:04.704143 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:04.704176 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:37281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 06:42:04.704392 10460 catalog_manager.cc:4584] TS f4ff225fcaf94ca38cca328fd345bd3a (127.27.41.129:37281): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d7418da4b2b4477bb6fbfa5a280dc501: Network error: Client connection negotiation failed: client connection to 127.27.41.129:37281: connect: Connection refused (error 111)
I20260810 06:42:04.708820 11201 ts_tablet_manager.cc:1905] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:42:04.710508 11201 ts_tablet_manager.cc:1918] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:42:04.710589 11201 log.cc:1196] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/d7418da4b2b4477bb6fbfa5a280dc501
I20260810 06:42:04.711166 11201 ts_tablet_manager.cc:1939] T d7418da4b2b4477bb6fbfa5a280dc501 P 3bdc63070ef1460eaf76d11be4a46e99: Deleting consensus metadata
I20260810 06:42:04.711627 10464 catalog_manager.cc:4841] TS 3bdc63070ef1460eaf76d11be4a46e99 (127.27.41.131:45787): tablet d7418da4b2b4477bb6fbfa5a280dc501 (table test-table [id=43c0b78279b44be5833a8f67abc84cd9]) successfully deleted
I20260810 06:42:04.712694 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 10966
I20260810 06:42:04.726938 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 10436
I20260810 06:42:04.734926 27814 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 06:42:05.079900 27814 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 06:42:05.080008 27814 mini_ranger.cc:66] Stopping Ranger...
I20260810 06:42:05.435431 27814 mini_ranger.cc:68] Stopped Ranger
2026-08-10 06:42:05.435 UTC [9867] LOG: received smart shutdown request
2026-08-10 06:42:05.439 UTC [9867] LOG: background worker "logical replication launcher" (PID 9880) exited with exit code 1
2026-08-10 06:42:05.439 UTC [9873] LOG: shutting down
2026-08-10 06:42:05.600 UTC [9867] LOG: database system is shut down
2026-08-10T06:42:05Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48549 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:42:05 dist-test-slave-bw88 krb5kdc[11219](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:42:05 dist-test-slave-bw88 krb5kdc[11219](info): set up 2 sockets
Aug 10 06:42:05 dist-test-slave-bw88 krb5kdc[11219](info): commencing operation
krb5kdc: starting...
W20260810 06:42:06.898430 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:42:06 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:42:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:42:06Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.27.41.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.27.41.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/rangeradmin_127.27.41.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/rangeradmin_127.27.41.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.27.41.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.27.41.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/rangerlookup_127.27.41.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/rangerlookup_127.27.41.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.41.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.27.41.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/HTTP_127.27.41.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/HTTP_127.27.41.148@KRBTEST.COM.keytab.
I20260810 06:42:07.068312 27814 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskyPrKbq/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/postgres -l logfile start
2026-08-10 06:42:09.509 UTC [11255] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 06:42:09.509 UTC [11255] LOG: listening on IPv4 address "127.27.41.148", port 52837
2026-08-10 06:42:09.512 UTC [11255] LOG: listening on Unix socket "/tmp/.s.PGSQL.52837"
2026-08-10 06:42:09.548 UTC [11259] LOG: database system was shut down at 2026-08-10 06:42:08 UTC
2026-08-10 06:42:09.553 UTC [11255] LOG: database system is ready to accept connections
I20260810 06:42:10.674588 27814 mini_postgres.cc:96] Postgres bound to 52837
2026-08-10 06:42:10.681 UTC [11269] FATAL: database "slave" does not exist
127.27.41.148:52837 - accepting connections
I20260810 06:42:10.682353 27814 mini_ranger.cc:161] Starting Ranger...
I20260810 06:42:10.698019 27814 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 06:42:11.152897 27814 mini_ranger.cc:87] Created ranger Postgres database
I20260810 06:42:11.152969 27814 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-admin
2026-08-10 06:42:11,424 [I] DB FLAVOR :POSTGRES
2026-08-10 06:42:11,425 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 06:42:11,425 [I] Checking connection..
2026-08-10 06:42:11,425 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 06:42:11,689 [I] Checking connection passed.
2026-08-10 06:42:11,690 [I] --------- Verifying version history table ---------
2026-08-10 06:42:11,690 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 06:42:11,960 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 06:42:11,960 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 06:42:12,229 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 06:42:12,230 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 06:42:12,230 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 06:42:12.496 UTC [11359] WARNING: there is no transaction in progress
2026-08-10 06:42:12,503 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 06:42:12,504 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 06:42:12,773 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 06:42:12,773 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 06:42:12,773 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 06:42:13,041 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 06:42:13,304 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-bw88.c.gcp-upstream.internal','N') ;"
2026-08-10 06:42:13,557 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 06:42:13,823 [I] Table x_portal_user does not exist in database ranger
2026-08-10 06:42:13,823 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 06:42:14,089 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 06:42:14,089 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 06:42:14,344 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 06:42:14,608 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 06:42:14,608 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 06:42:15.566 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.582 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.598 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.613 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.628 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.646 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.709 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.715 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.729 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.738 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.748 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.761 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.771 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.777 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.783 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:15.790 UTC [11513] WARNING: there is no transaction in progress
2026-08-10 06:42:16,425 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 06:42:16,425 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 06:42:16,671 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 06:42:16,671 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 06:42:16,927 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 06:42:16,927 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 06:42:17,195 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 06:42:17,196 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 06:42:17,438 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 06:42:17,704 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-bw88.c.gcp-upstream.internal';"
2026-08-10 06:42:17,965 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 06:42:17,966 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 06:42:18,237 [I] DB_PATCHES have already been applied
I20260810 06:42:18.243137 27814 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-admin:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskyPrKbq/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 06:42:18.243212 27814 mini_ranger.cc:193] Using host: 127.27.41.148
I20260810 06:42:18.247121 27814 mini_ranger.cc:227] Ranger admin URL: http://127.27.41.148:39113
Aug 10, 2026 6:42:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 6:42:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 6:42:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 6:42:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 6:42:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 6:42:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 6:42:19 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 06:42:19.538583 27814 mini_ranger.cc:160] Time spent starting Ranger: real 8.856s user 0.000s sys 0.010s
Aug 10, 2026 6:42:39 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 6:42:39 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 6:42:39 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 6:42:39 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 6:42:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 6:42:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 6:42:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 6:42:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 6:42:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 6:42:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 6:42:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 6:42:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 6:42:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 6:42:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 6:42:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 6:42:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 6:42:39 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 6:42:40 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 06:42:41.310838 27814 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.27.41.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.27.41.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/rangerkms_127.27.41.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.27.41.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/rangerkms_127.27.41.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.41.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.27.41.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.41.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/HTTP_127.27.41.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.41.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/HTTP_127.27.41.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 06:42:41 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344161, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 06:42:41.398849 27814 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 06:42:41.408479 27814 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 06:42:42.220074 27814 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 06:42:42.220171 27814 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-kms
I20260810 06:42:42.220189 27814 mini_ranger_kms.cc:227] Using postgres at 127.27.41.148:52837
2026-08-10 06:42:42,439 [I] DB FLAVOR :POSTGRES
2026-08-10 06:42:42,439 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 06:42:42,439 [I] Checking connection
2026-08-10 06:42:42,440 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 06:42:42,729 [I] connection success
2026-08-10 06:42:42,730 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 06:42:42,730 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 06:42:42,730 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 06:42:42,997 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 06:42:42,998 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 06:42:42,998 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 06:42:42,998 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.41.148:52837/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 06:42:43,293 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 06:42:43.759860 27814 mini_ranger_kms.cc:310] Created kms service
I20260810 06:42:43.951907 27814 mini_ranger_kms.cc:326] Created kudu user
I20260810 06:42:44.014407 27814 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 06:42:44 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344161, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:44.446199 27814 mini_ranger_kms.cc:384] Added ranger policy
I20260810 06:42:44.446432 27814 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-kms:/tmp/dist-test-taskyPrKbq/build/release/bin/postgresql.jar:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskyPrKbq/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 06:42:44.446470 27814 mini_ranger_kms.cc:240] Using host: 127.27.41.148
I20260810 06:42:44.450839 27814 mini_ranger_kms.cc:276] Ranger KMS PID: 11766
I20260810 06:42:44.450923 27814 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.27.41.148:51207
Aug 10, 2026 6:42:45 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 6:42:45 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 6:42:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 6:42:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 6:42:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 6:42:46 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 06:42:46 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786344166, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.41.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:47.081120 27814 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.682s user 0.003s sys 0.198s
I20260810 06:42:47.081244 27814 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 06:42:47.081290 27814 mini_ranger_kms.cc:401] 127.27.41.148:51207/kms/v1/keys
Aug 10 06:42:47 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344166, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.41.148@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
Aug 10 06:42:47 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344166, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.41.148@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
Aug 10 06:42:49 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:42:49.887539 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:40933
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:40933
--ranger_config_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.41.148:51207/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:42:49.985013 11839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:49.985246 11839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:49.985284 11839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:49.986518 11839 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:42:49.986582 11839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:49.986605 11839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:49.986635 11839 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:42:49.986660 11839 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:42:49.988226 11839 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/wal
--ranger_kms_url=127.27.41.148:51207/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:40933
--ranger_config_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:40933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:49.988497 11839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:49.988718 11839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:49.994067 11846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:49.994143 11847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:49.994213 11839 server_base.cc:1034] running on GCE node
W20260810 06:42:49.994243 11853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:49.994539 11839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:49.994884 11839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:49.996042 11839 hybrid_clock.cc:648] HybridClock initialized: now 1786344169996030 us; error 29 us; skew 500 ppm
Aug 10 06:42:49 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344169, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:50.001543 11839 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:42:50.002068 11839 webserver.cc:460] Webserver started at http://127.27.41.190:43041/ using document root <none> and password file <none>
I20260810 06:42:50.002319 11839 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:50.002360 11839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:42:50.002506 11839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:42:49 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344169, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:50.049436 11839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "403b6df794c34ba0abba0cd35f8bd3d5"
format_stamp: "Formatted at 2026-08-10 06:42:50 on dist-test-slave-bw88"
server_key: "1db12b4bdcfabbc0f3753d22f71a1f1a"
server_key_iv: "ba7786ea73c2415894aa011f2b79a945"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:50.049860 11839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "403b6df794c34ba0abba0cd35f8bd3d5"
format_stamp: "Formatted at 2026-08-10 06:42:50 on dist-test-slave-bw88"
server_key: "1db12b4bdcfabbc0f3753d22f71a1f1a"
server_key_iv: "ba7786ea73c2415894aa011f2b79a945"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:50.051347 11839 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 06:42:50.062455 11860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:50.062655 11839 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:42:50.062760 11839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "403b6df794c34ba0abba0cd35f8bd3d5"
format_stamp: "Formatted at 2026-08-10 06:42:50 on dist-test-slave-bw88"
server_key: "1db12b4bdcfabbc0f3753d22f71a1f1a"
server_key_iv: "ba7786ea73c2415894aa011f2b79a945"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:50.062872 11839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:50.078413 11839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:50.080380 11839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:50.080551 11839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:50.085809 11839 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:40933
I20260810 06:42:50.085850 11928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:40933 every 8 connection(s)
I20260810 06:42:50.086228 11839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:42:50.087142 11929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:42:50.090433 11929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5: Bootstrap starting.
I20260810 06:42:50.091218 11929 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5: Neither blocks nor log segments found. Creating new log.
I20260810 06:42:50.091614 11929 log.cc:824] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5: Log is configured to *not* fsync() on all Append() calls
I20260810 06:42:50.092501 11929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5: No bootstrap required, opened a new log
I20260810 06:42:50.094367 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 11839
I20260810 06:42:50.094496 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:42:50.094723 27814 external_mini_cluster.cc:1428] Setting key 379b0161f6d091ead95f1708dd303530
I20260810 06:42:50.095445 11929 raft_consensus.cc:348] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40933 } }
I20260810 06:42:50.095652 11929 raft_consensus.cc:374] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:42:50.095687 11929 raft_consensus.cc:729] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 403b6df794c34ba0abba0cd35f8bd3d5, State: Initialized, Role: FOLLOWER
I20260810 06:42:50.095853 11929 consensus_queue.cc:260] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40933 } }
I20260810 06:42:50.096029 11929 raft_consensus.cc:388] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:42:50.096081 11929 raft_consensus.cc:482] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:42:50.096148 11929 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:42:50.096935 11929 raft_consensus.cc:504] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40933 } }
I20260810 06:42:50.097047 11929 leader_election.cc:302] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 403b6df794c34ba0abba0cd35f8bd3d5; no voters:
I20260810 06:42:50.097237 11929 leader_election.cc:288] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:42:50.097293 11939 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:42:50.097535 11939 raft_consensus.cc:686] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 1 LEADER]: Becoming Leader. State: Replica: 403b6df794c34ba0abba0cd35f8bd3d5, State: Running, Role: LEADER
I20260810 06:42:50.097609 11929 sys_catalog.cc:564] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:42:50.097669 11939 consensus_queue.cc:237] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40933 } }
I20260810 06:42:50.098022 11939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40933 } } }
I20260810 06:42:50.098181 11939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [sys.catalog]: This master's current role is: LEADER
I20260810 06:42:50.098385 11939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 403b6df794c34ba0abba0cd35f8bd3d5. Latest consensus state: current_term: 1 leader_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40933 } } }
I20260810 06:42:50.098507 11939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [sys.catalog]: This master's current role is: LEADER
I20260810 06:42:50.098659 11950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:42:50.099190 11950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:42:50.099576 11929 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 10 06:42:50 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:42:50.103535 11965 mvcc.cc:205] Tried to move back new op lower bound from 7316865720730398720 to 7316865720720596992. Current Snapshot: MvccSnapshot[applied={T|T < 7316865720730398720}]
I20260810 06:42:50.104575 11950 catalog_manager.cc:1347] Generated new cluster ID: 185161885a5b45dfa9ebb9faeed83f01
I20260810 06:42:50.104645 11950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:42:50.107836 11936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:50.095301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52804 (local address 127.27.41.190:40933)
0810 06:42:50.095541 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:50.095551 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:50.095590 (+ 39us) server_negotiation.cc:407] Connection header received
0810 06:42:50.095723 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:50.095731 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:50.095791 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:50.095934 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:50.096686 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:50.098043 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:50.099199 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:50.099765 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:50.103053 (+ 3288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:50.103450 (+ 397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:50.103458 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:50.103458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:50.103475 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:50.105944 (+ 2469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:50.106324 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:50.106327 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:50.106327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:50.106434 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:50.106610 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:50.106611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:50.106611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:50.106894 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:50.107419 (+ 525us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:50.107486 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 06:42:50.107624 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":119,"threads_started":1}
I20260810 06:42:50.115919 11950 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:42:50.116791 11950 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:42:50.123618 11950 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5: Generated new TSK 0
I20260810 06:42:50.124007 11950 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:42:50.960799 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.41.148:51207/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:40933
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:42:51.083314 12003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:51.083621 12003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:51.083663 12003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:51.085485 12003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:51.088534 12003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:51.088637 12003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:42:51.090976 12003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.27.41.148:51207/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:40933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:51.091356 12003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:51.091660 12003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:51.098763 12015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:51.099701 12013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:51.099968 12017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:51.100224 12003 server_base.cc:1034] running on GCE node
I20260810 06:42:51.100469 12003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:51.100759 12003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:51.101940 12003 hybrid_clock.cc:648] HybridClock initialized: now 1786344171101909 us; error 38 us; skew 500 ppm
Aug 10 06:42:51 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344171, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:51.105269 12003 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:42:51.105819 12003 webserver.cc:460] Webserver started at http://127.27.41.129:35251/ using document root <none> and password file <none>
I20260810 06:42:51.106086 12003 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:51.106144 12003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:42:51.106328 12003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:42:51 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344171, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:51.120265 12003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "565d6eff164248409cff19a85c73d5d4"
format_stamp: "Formatted at 2026-08-10 06:42:51 on dist-test-slave-bw88"
server_key: "e14065f3be1e2161f51d93b6979551ca"
server_key_iv: "124034e7effb0ec5737b70072ecea67a"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:51.120707 12003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "565d6eff164248409cff19a85c73d5d4"
format_stamp: "Formatted at 2026-08-10 06:42:51 on dist-test-slave-bw88"
server_key: "e14065f3be1e2161f51d93b6979551ca"
server_key_iv: "124034e7effb0ec5737b70072ecea67a"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:51.123028 12003 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 06:42:51.137848 12028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:51.138355 12003 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 06:42:51.138484 12003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "565d6eff164248409cff19a85c73d5d4"
format_stamp: "Formatted at 2026-08-10 06:42:51 on dist-test-slave-bw88"
server_key: "e14065f3be1e2161f51d93b6979551ca"
server_key_iv: "124034e7effb0ec5737b70072ecea67a"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:51.138598 12003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:51.169085 12003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:51.171762 12003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:51.171998 12003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:51.172348 12003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:42:51.172855 12003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:42:51.172969 12003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:51.173074 12003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:42:51.173157 12003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:51.180680 12003 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:35279
I20260810 06:42:51.181294 12003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:42:51.183944 12196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:35279 every 8 connection(s)
I20260810 06:42:51.186630 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 12003
I20260810 06:42:51.186749 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:42:51.186987 27814 external_mini_cluster.cc:1428] Setting key cb6a4fd994340b4bdf37b99cbdbf7be0
Aug 10 06:42:51 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344171, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
I20260810 06:42:51.199175 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:51.184929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:37759 (local address 127.27.41.190:40933)
0810 06:42:51.185273 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:51.185276 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:51.185538 (+ 262us) server_negotiation.cc:407] Connection header received
0810 06:42:51.186272 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:51.186273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:51.186290 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:51.186379 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:51.190013 (+ 3634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:51.190803 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:51.192507 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:51.192819 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:51.192880 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:51.195655 (+ 2775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:51.195657 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:51.195657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:51.195665 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:51.197571 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:51.198048 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:51.198049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:51.198050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:51.198113 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:51.198367 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:51.198368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:51.198368 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:51.198501 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:51.198559 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:51.198937 (+ 378us) server_negotiation.cc:299] Negotiation successful
0810 06:42:51.199037 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":64,"threads_started":1}
I20260810 06:42:51.199256 12199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:51.184603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:40933 (local address 127.27.41.129:37759)
0810 06:42:51.185368 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:51.185418 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:51.186122 (+ 704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:51.187233 (+ 1111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:51.187238 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:51.187489 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:51.189889 (+ 2400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:51.189897 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:51.190908 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:51.190910 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:51.192406 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:51.192409 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:51.192977 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:51.192978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:51.193118 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:51.193874 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:51.193885 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:51.195550 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:51.197664 (+ 2114us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:51.197670 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:51.197673 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:51.197965 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:51.198178 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:51.198178 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:51.198179 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:51.198302 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:51.198583 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:51.198589 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:51.198746 (+ 157us) client_negotiation.cc:769] Sending connection context
0810 06:42:51.198852 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 06:42:51.199020 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":96,"threads_started":1}
I20260810 06:42:51.200268 12197 heartbeater.cc:347] Connected to a master server at 127.27.41.190:40933
I20260810 06:42:51.200385 12197 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:51.200593 12197 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
I20260810 06:42:51.201319 11884 ts_manager.cc:194] Registered new tserver with Master: 565d6eff164248409cff19a85c73d5d4 (127.27.41.129:35279)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
I20260810 06:42:51.202441 11884 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:37759
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:42:51.223968 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.41.148:51207/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:40933
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:42:51 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786344171, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 06:42:51.348160 12203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:51.348433 12203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:51.348466 12203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:51.350147 12203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:51.350209 12203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:51.350247 12203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:42:51.352298 12203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.27.41.148:51207/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:40933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:51.352545 12203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:51.352799 12203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:51.358887 12216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:51.359251 12212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:51.359467 12203 server_base.cc:1034] running on GCE node
W20260810 06:42:51.359388 12211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:51.359715 12203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:51.359982 12203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:51.361197 12203 hybrid_clock.cc:648] HybridClock initialized: now 1786344171361148 us; error 42 us; skew 500 ppm
Aug 10 06:42:51 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344171, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:51.364531 12203 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:42:51.365020 12203 webserver.cc:460] Webserver started at http://127.27.41.130:33787/ using document root <none> and password file <none>
I20260810 06:42:51.365262 12203 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:51.365316 12203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:42:51.365473 12203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:42:51 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344171, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:51.384729 12203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "817df6dc120b4a4e9a4be10e57604b38"
format_stamp: "Formatted at 2026-08-10 06:42:51 on dist-test-slave-bw88"
server_key: "a3d3ac53ad58f6699615435a37a329ab"
server_key_iv: "2104daf128631e55a52cb2931bdb77ba"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:51.385228 12203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "817df6dc120b4a4e9a4be10e57604b38"
format_stamp: "Formatted at 2026-08-10 06:42:51 on dist-test-slave-bw88"
server_key: "a3d3ac53ad58f6699615435a37a329ab"
server_key_iv: "2104daf128631e55a52cb2931bdb77ba"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:51.389698 12203 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.001s
I20260810 06:42:51.404335 12228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:51.404649 12203 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 06:42:51.404740 12203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "817df6dc120b4a4e9a4be10e57604b38"
format_stamp: "Formatted at 2026-08-10 06:42:51 on dist-test-slave-bw88"
server_key: "a3d3ac53ad58f6699615435a37a329ab"
server_key_iv: "2104daf128631e55a52cb2931bdb77ba"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:51.404832 12203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:51.454466 12203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:51.457136 12203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:51.457381 12203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:51.457706 12203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:42:51.458174 12203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:42:51.458272 12203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:51.458351 12203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:42:51.458416 12203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:51.465437 12203 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:35241
I20260810 06:42:51.470598 12203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:42:51.471983 12390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:35241 every 8 connection(s)
I20260810 06:42:51.476094 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 12203
I20260810 06:42:51.476208 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:42:51.476442 27814 external_mini_cluster.cc:1428] Setting key 89f986798772dc43bc3f69701d890381
Aug 10 06:42:51 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344171, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:42:51.484211 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:51.473090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:44657 (local address 127.27.41.190:40933)
0810 06:42:51.473141 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:51.473143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:51.473523 (+ 380us) server_negotiation.cc:407] Connection header received
0810 06:42:51.474291 (+ 768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:51.474293 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:51.474311 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:51.474342 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:51.475228 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:51.475999 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:51.477527 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:51.477829 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:51.477875 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:51.480635 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:51.480637 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:51.480637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:51.480645 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:51.482468 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:51.483008 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:51.483009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:51.483010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:51.483073 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:51.483386 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:51.483387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:51.483387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:51.483535 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:51.483584 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:51.483995 (+ 411us) server_negotiation.cc:299] Negotiation successful
0810 06:42:51.484096 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 06:42:51.484978 12396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:51.472757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:40933 (local address 127.27.41.130:44657)
0810 06:42:51.473387 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:51.473435 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:51.474141 (+ 706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:51.474543 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:51.474547 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:51.474797 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:51.475109 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:51.475116 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:51.476122 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:51.476123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:51.477421 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:51.477424 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:51.478001 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:51.478001 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:51.478144 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:51.478776 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:51.478786 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:51.480511 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:51.482570 (+ 2059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:51.482579 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:51.482581 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:51.482887 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:51.483152 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:51.483153 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:51.483153 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:51.483294 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:51.483639 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:51.483645 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:51.483813 (+ 168us) client_negotiation.cc:769] Sending connection context
0810 06:42:51.484569 (+ 756us) client_negotiation.cc:240] Negotiation successful
0810 06:42:51.484738 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":86,"threads_started":1}
I20260810 06:42:51.485682 12391 heartbeater.cc:347] Connected to a master server at 127.27.41.190:40933
I20260810 06:42:51.485780 12391 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:51.486001 12391 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
I20260810 06:42:51.486446 11884 ts_manager.cc:194] Registered new tserver with Master: 817df6dc120b4a4e9a4be10e57604b38 (127.27.41.130:35241)
I20260810 06:42:51.486928 11884 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:44657
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:42:51.524528 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.41.148:51207/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:40933
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:42:51.640585 12401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:51.640934 12401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:51.641040 12401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:51.642805 12401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:51.642983 12401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:51.643080 12401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:42:51.645370 12401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.27.41.148:51207/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:40933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:51.645834 12401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:51.646171 12401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:51.652781 12409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:51.653246 12407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:51.653339 12406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:51.654387 12401 server_base.cc:1034] running on GCE node
I20260810 06:42:51.654615 12401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:51.654882 12401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:51.656050 12401 hybrid_clock.cc:648] HybridClock initialized: now 1786344171656027 us; error 36 us; skew 500 ppm
Aug 10 06:42:51 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344171, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:51.659286 12401 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:42:51.659785 12401 webserver.cc:460] Webserver started at http://127.27.41.131:39539/ using document root <none> and password file <none>
I20260810 06:42:51.660059 12401 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:51.660118 12401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:42:51.660241 12401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:42:51 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344171, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:51.684279 12401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "0caa53e72505488689ec3698c51faab8"
format_stamp: "Formatted at 2026-08-10 06:42:51 on dist-test-slave-bw88"
server_key: "52d9017cdbf13c5f6beb45423641590b"
server_key_iv: "f2a117f5464d6ffe03c122d2e09ddeab"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:51.684755 12401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "0caa53e72505488689ec3698c51faab8"
format_stamp: "Formatted at 2026-08-10 06:42:51 on dist-test-slave-bw88"
server_key: "52d9017cdbf13c5f6beb45423641590b"
server_key_iv: "f2a117f5464d6ffe03c122d2e09ddeab"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:51.687815 12401 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:42:51.705545 12421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:51.705735 12401 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 06:42:51.705842 12401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "0caa53e72505488689ec3698c51faab8"
format_stamp: "Formatted at 2026-08-10 06:42:51 on dist-test-slave-bw88"
server_key: "52d9017cdbf13c5f6beb45423641590b"
server_key_iv: "f2a117f5464d6ffe03c122d2e09ddeab"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:51.705950 12401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:51.725904 12401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:51.728251 12401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:51.728386 12401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:51.728585 12401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:42:51.728943 12401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:42:51.728987 12401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:51.729017 12401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:42:51.729038 12401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:51.735803 12401 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:44275
I20260810 06:42:51.736202 12401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:42:51.738121 12591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:44275 every 8 connection(s)
I20260810 06:42:51.742597 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 12401
I20260810 06:42:51.742725 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:42:51.742951 27814 external_mini_cluster.cc:1428] Setting key 78f32b56f1db167541c16f681c6b7321
Aug 10 06:42:51 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344171, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:42:51.750579 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:51.738929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:39145 (local address 127.27.41.190:40933)
0810 06:42:51.738992 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:51.738994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:51.739379 (+ 385us) server_negotiation.cc:407] Connection header received
0810 06:42:51.740224 (+ 845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:51.740226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:51.740240 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:51.740271 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:51.741088 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:51.741916 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:51.744113 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:51.744569 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:51.744637 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:51.747364 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:51.747365 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:51.747366 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:51.747373 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:51.749046 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:51.749536 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:51.749537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:51.749538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:51.749612 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:51.749873 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:51.749873 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:51.749874 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:51.749999 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:51.750041 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:51.750392 (+ 351us) server_negotiation.cc:299] Negotiation successful
0810 06:42:51.750485 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 06:42:51.751055 12596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:51.738902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:40933 (local address 127.27.41.131:39145)
0810 06:42:51.739251 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:51.739291 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:51.740098 (+ 807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:51.740467 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:51.740471 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:51.740710 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:51.740980 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:51.740985 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:51.742108 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:51.742109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:51.743971 (+ 1862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:51.743974 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:51.744789 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:51.744790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:51.744993 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:51.745654 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:51.745664 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:51.747255 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:51.749134 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:51.749141 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:51.749143 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:51.749450 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:51.749681 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:51.749682 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:51.749682 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:51.749804 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:51.750087 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:51.750093 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:51.750247 (+ 154us) client_negotiation.cc:769] Sending connection context
0810 06:42:51.750674 (+ 427us) client_negotiation.cc:240] Negotiation successful
0810 06:42:51.750841 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":82,"threads_started":1}
I20260810 06:42:51.751562 12592 heartbeater.cc:347] Connected to a master server at 127.27.41.190:40933
I20260810 06:42:51.751659 12592 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:51.751842 12592 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
I20260810 06:42:51.752180 11884 ts_manager.cc:194] Registered new tserver with Master: 0caa53e72505488689ec3698c51faab8 (127.27.41.131:44275)
I20260810 06:42:51.752671 11884 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:39145
I20260810 06:42:51.754624 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:42:51.755339 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 12003
I20260810 06:42:51.765658 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 12203
I20260810 06:42:51.773476 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 12401
I20260810 06:42:51.788635 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 11839
I20260810 06:42:51.801700 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:40933
--webserver_interface=127.27.41.190
--webserver_port=43041
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:40933
--ranger_config_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.41.148:51207/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.41.148:51207/kms with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:42:51.883184 12598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:51.883383 12598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:51.883404 12598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:51.884550 12598 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:42:51.884593 12598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:51.884608 12598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:51.884619 12598 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:42:51.884631 12598 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:42:51.886179 12598 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.41.148:51207/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:40933
--ranger_config_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:40933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=43041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:51.886401 12598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:51.886660 12598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:42:51.891654 12598 server_base.cc:1034] running on GCE node
W20260810 06:42:51.891634 12611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:51.891621 12606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:51.891614 12608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:51.892079 12598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:51.892383 12598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:51.893523 12598 hybrid_clock.cc:648] HybridClock initialized: now 1786344171893507 us; error 39 us; skew 500 ppm
Aug 10 06:42:51 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344171, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:51.896215 12598 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:42:51.896659 12598 webserver.cc:460] Webserver started at http://127.27.41.190:43041/ using document root <none> and password file <none>
I20260810 06:42:51.896898 12598 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:51.896953 12598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 06:42:52 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344171, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:52.335983 12598 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260810 06:42:52.337172 12623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:52.337411 12598 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:42:52.337563 12598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "403b6df794c34ba0abba0cd35f8bd3d5"
format_stamp: "Formatted at 2026-08-10 06:42:50 on dist-test-slave-bw88"
server_key: "1db12b4bdcfabbc0f3753d22f71a1f1a"
server_key_iv: "ba7786ea73c2415894aa011f2b79a945"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:52.337944 12598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:52.365952 12598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:52.367806 12598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:52.367975 12598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:52.372373 12598 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:40933
I20260810 06:42:52.372414 12699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:40933 every 8 connection(s)
I20260810 06:42:52.372795 12598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:42:52.373731 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 12598
I20260810 06:42:52.374045 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.41.148:51207/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:35279
--local_ip_for_outbound_sockets=127.27.41.129
--tserver_master_addrs=127.27.41.190:40933
--webserver_port=35251
--webserver_interface=127.27.41.129
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.41.148:51207/kms with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:42:52.374145 12700 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:42:52.374797 12700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5: Bootstrap starting.
I20260810 06:42:52.382858 12700 log.cc:824] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5: Log is configured to *not* fsync() on all Append() calls
I20260810 06:42:52.384735 12700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:42:52.385042 12700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5: Bootstrap complete.
I20260810 06:42:52.387411 12700 raft_consensus.cc:348] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40933 } }
I20260810 06:42:52.387671 12700 raft_consensus.cc:729] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 403b6df794c34ba0abba0cd35f8bd3d5, State: Initialized, Role: FOLLOWER
I20260810 06:42:52.387879 12700 consensus_queue.cc:260] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40933 } }
I20260810 06:42:52.387979 12700 raft_consensus.cc:388] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:42:52.388034 12700 raft_consensus.cc:482] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:42:52.388083 12700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 1 FOLLOWER]: Advancing to term 2
I20260810 06:42:52.389075 12700 raft_consensus.cc:504] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40933 } }
I20260810 06:42:52.389199 12700 leader_election.cc:302] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 403b6df794c34ba0abba0cd35f8bd3d5; no voters:
I20260810 06:42:52.389403 12700 leader_election.cc:288] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 06:42:52.389456 12704 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 06:42:52.389598 12704 raft_consensus.cc:686] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [term 2 LEADER]: Becoming Leader. State: Replica: 403b6df794c34ba0abba0cd35f8bd3d5, State: Running, Role: LEADER
I20260810 06:42:52.389690 12700 sys_catalog.cc:564] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:42:52.389703 12704 consensus_queue.cc:237] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40933 } }
I20260810 06:42:52.390012 12704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 403b6df794c34ba0abba0cd35f8bd3d5. Latest consensus state: current_term: 2 leader_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40933 } } }
I20260810 06:42:52.390091 12704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [sys.catalog]: This master's current role is: LEADER
I20260810 06:42:52.390246 12705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "403b6df794c34ba0abba0cd35f8bd3d5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40933 } } }
I20260810 06:42:52.390336 12705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5 [sys.catalog]: This master's current role is: LEADER
I20260810 06:42:52.390431 12710 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:42:52.390965 12710 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:42:52.391113 12710 catalog_manager.cc:1259] Loaded cluster ID: 185161885a5b45dfa9ebb9faeed83f01
I20260810 06:42:52.391150 12710 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:42:52.391825 12700 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 06:42:52.395237 12710 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:42:52.395895 12710 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5: Loaded TSK: 0
I20260810 06:42:52.396253 12710 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 06:42:52.486348 12702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:52.486649 12702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:52.486692 12702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:52.488335 12702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:52.488415 12702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:52.488473 12702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:42:52.490626 12702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.41.148:51207/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:35279
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=35251
--tserver_master_addrs=127.27.41.190:40933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:52.490855 12702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:52.491097 12702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:52.497563 12749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:52.497563 12750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:52.497764 12756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:52.498502 12702 server_base.cc:1034] running on GCE node
I20260810 06:42:52.498764 12702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:52.499015 12702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:52.500159 12702 hybrid_clock.cc:648] HybridClock initialized: now 1786344172500128 us; error 43 us; skew 500 ppm
Aug 10 06:42:52 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344172, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:52.503589 12702 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:42:52.504109 12702 webserver.cc:460] Webserver started at http://127.27.41.129:35251/ using document root <none> and password file <none>
I20260810 06:42:52.504372 12702 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:52.504447 12702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 06:42:52 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344172, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:52.533910 12702 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.001s sys 0.000s
I20260810 06:42:52.537824 12771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:52.537997 12702 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260810 06:42:52.538091 12702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "565d6eff164248409cff19a85c73d5d4"
format_stamp: "Formatted at 2026-08-10 06:42:51 on dist-test-slave-bw88"
server_key: "e14065f3be1e2161f51d93b6979551ca"
server_key_iv: "124034e7effb0ec5737b70072ecea67a"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:52.538609 12702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:52.551510 12702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:52.554141 12702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:52.554303 12702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:52.554522 12702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:42:52.554952 12702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:42:52.554991 12702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:52.555018 12702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:42:52.555035 12702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:52.564440 12702 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:35279
I20260810 06:42:52.564877 12702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:42:52.567330 12947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:35279 every 8 connection(s)
I20260810 06:42:52.572777 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 12702
I20260810 06:42:52.573122 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.41.148:51207/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:35241
--local_ip_for_outbound_sockets=127.27.41.130
--tserver_master_addrs=127.27.41.190:40933
--webserver_port=33787
--webserver_interface=127.27.41.130
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.41.148:51207/kms with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:42:52 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344172, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:42:52.580933 12950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:52.567953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:40933 (local address 127.27.41.129:36813)
0810 06:42:52.568360 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:52.568402 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:52.568997 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:52.570007 (+ 1010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:52.570012 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:52.570256 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:52.570540 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:52.570547 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.572217 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.572218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:52.573585 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:52.573588 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.574399 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.574400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:52.574545 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:52.575154 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:52.575164 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:52.576965 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:52.579298 (+ 2333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:52.579304 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:52.579306 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:52.579597 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:52.579844 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:52.579845 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:52.579845 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:52.579947 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:52.580346 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:52.580351 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:52.580479 (+ 128us) client_negotiation.cc:769] Sending connection context
0810 06:42:52.580568 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 06:42:52.580712 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":89,"threads_started":1}
I20260810 06:42:52.581964 12954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:52.568016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:36813 (local address 127.27.41.190:40933)
0810 06:42:52.569508 (+ 1492us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:52.569517 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:52.569563 (+ 46us) server_negotiation.cc:407] Connection header received
0810 06:42:52.569715 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:52.569720 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:52.569770 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:52.569891 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:52.570680 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.572088 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.573699 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.574275 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.574822 (+ 547us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:52.577141 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:52.577145 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:52.577146 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:52.577159 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:52.579199 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:52.579685 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:52.579687 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:52.579688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:52.579778 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:52.580010 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:52.580011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:52.580011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:52.580271 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:52.581571 (+ 1300us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:52.581647 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 06:42:52.581765 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1436,"thread_start_us":96,"threads_started":1}
I20260810 06:42:52.582778 12948 heartbeater.cc:347] Connected to a master server at 127.27.41.190:40933
I20260810 06:42:52.582865 12948 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:52.583036 12948 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
W20260810 06:42:52.583865 12948 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:40933 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 06:42:52.583928 12948 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:52.583982 12948 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
I20260810 06:42:52.584405 12948 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:52.584476 12948 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
W20260810 06:42:52.584851 12948 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:42:52.688222 12955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:52.688585 12955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:52.688694 12955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:52.690440 12955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:52.690501 12955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:52.690549 12955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:42:52.692688 12955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.41.148:51207/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:35241
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=33787
--tserver_master_addrs=127.27.41.190:40933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:52.692934 12955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:52.693199 12955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:52.699810 12968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:52.700037 12964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:52.700136 12965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:52.700378 12955 server_base.cc:1034] running on GCE node
I20260810 06:42:52.700616 12955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:52.700903 12955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:52.702098 12955 hybrid_clock.cc:648] HybridClock initialized: now 1786344172702076 us; error 37 us; skew 500 ppm
Aug 10 06:42:52 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344172, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:52.705318 12955 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:42:52.705854 12955 webserver.cc:460] Webserver started at http://127.27.41.130:33787/ using document root <none> and password file <none>
I20260810 06:42:52.706139 12955 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:52.706233 12955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 06:42:52 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344172, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:52.725768 12955 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260810 06:42:52.727387 12983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:52.727662 12955 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 06:42:52.727777 12955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "817df6dc120b4a4e9a4be10e57604b38"
format_stamp: "Formatted at 2026-08-10 06:42:51 on dist-test-slave-bw88"
server_key: "a3d3ac53ad58f6699615435a37a329ab"
server_key_iv: "2104daf128631e55a52cb2931bdb77ba"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:52.728261 12955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:52.740638 12955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:52.743093 12955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:52.743260 12955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:52.743515 12955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:42:52.743886 12955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:42:52.743939 12955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:52.743976 12955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:42:52.743996 12955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:52.751401 12955 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:35241
I20260810 06:42:52.751879 12955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:42:52.753430 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 12955
I20260810 06:42:52.753759 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.41.148:51207/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:44275
--local_ip_for_outbound_sockets=127.27.41.131
--tserver_master_addrs=127.27.41.190:40933
--webserver_port=39539
--webserver_interface=127.27.41.131
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.41.148:51207/kms with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:42:52.755926 13153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:35241 every 8 connection(s)
Aug 10 06:42:52 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344172, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:42:52.763939 12954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:52.752631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:38527 (local address 127.27.41.190:40933)
0810 06:42:52.752687 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:52.752689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:52.752965 (+ 276us) server_negotiation.cc:407] Connection header received
0810 06:42:52.753698 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:52.753700 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:52.753718 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:52.753754 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:52.754645 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.755392 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.756887 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.757093 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.757156 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:52.759793 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:52.759794 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:52.759795 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:52.759803 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:52.762113 (+ 2310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:52.762723 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:52.762725 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:52.762726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:52.762797 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:52.763128 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:52.763130 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:52.763130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:52.763283 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:52.763364 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:52.763738 (+ 374us) server_negotiation.cc:299] Negotiation successful
0810 06:42:52.763837 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 06:42:52.764163 13156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:52.752647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:40933 (local address 127.27.41.130:38527)
0810 06:42:52.752810 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:52.752858 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:52.753557 (+ 699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:52.753954 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:52.753959 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:52.754196 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:52.754531 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:52.754538 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.755528 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.755528 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:52.756797 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:52.756800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.757212 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.757213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:52.757387 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:52.757952 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:52.757963 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:52.759684 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:52.762212 (+ 2528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:52.762219 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:52.762222 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:52.762626 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:52.762884 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:52.762885 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:52.762885 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:52.763044 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:52.763368 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:52.763375 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:52.763554 (+ 179us) client_negotiation.cc:769] Sending connection context
0810 06:42:52.763686 (+ 132us) client_negotiation.cc:240] Negotiation successful
0810 06:42:52.763867 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":81,"threads_started":1}
I20260810 06:42:52.764801 13154 heartbeater.cc:347] Connected to a master server at 127.27.41.190:40933
I20260810 06:42:52.764912 13154 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:52.765105 13154 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
W20260810 06:42:52.765906 13154 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:40933 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 06:42:52.765990 13154 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:52.766059 13154 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
I20260810 06:42:52.766434 13154 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:52.766525 13154 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
W20260810 06:42:52.766902 13154 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:42:52.869802 13157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:52.870096 13157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:52.870273 13157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:52.872021 13157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:52.872082 13157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:52.872125 13157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:42:52.874341 13157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.41.148:51207/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:44275
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=39539
--tserver_master_addrs=127.27.41.190:40933
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:52.874641 13157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:52.874912 13157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:52.881590 13171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:52.881780 13167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:52.881875 13168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:52.882242 13157 server_base.cc:1034] running on GCE node
I20260810 06:42:52.882474 13157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:52.882768 13157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:52.883948 13157 hybrid_clock.cc:648] HybridClock initialized: now 1786344172883914 us; error 47 us; skew 500 ppm
Aug 10 06:42:52 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344172, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:52.887717 13157 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:42:52.888345 13157 webserver.cc:460] Webserver started at http://127.27.41.131:39539/ using document root <none> and password file <none>
I20260810 06:42:52.888650 13157 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:52.888751 13157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 06:42:52 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344172, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:52.905181 13157 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:42:52.906339 13186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:52.906515 13157 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 06:42:52.906625 13157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "0caa53e72505488689ec3698c51faab8"
format_stamp: "Formatted at 2026-08-10 06:42:51 on dist-test-slave-bw88"
server_key: "52d9017cdbf13c5f6beb45423641590b"
server_key_iv: "f2a117f5464d6ffe03c122d2e09ddeab"
server_key_version: "kuduclusterkey@0"
I20260810 06:42:52.907023 13157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:52.931797 13157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:52.933929 13157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:52.934105 13157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:52.934347 13157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:42:52.934737 13157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:42:52.934801 13157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:52.934844 13157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:42:52.934870 13157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:52.941932 13157 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:44275
I20260810 06:42:52.942068 13347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:44275 every 8 connection(s)
I20260810 06:42:52.942466 13157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:42:52.946887 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 13157
Aug 10 06:42:52 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344172, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:42:52.953889 12954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:52.943370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:43537 (local address 127.27.41.190:40933)
0810 06:42:52.943423 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:52.943425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:52.943769 (+ 344us) server_negotiation.cc:407] Connection header received
0810 06:42:52.944466 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:52.944467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:52.944478 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:52.944533 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:52.945224 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.945876 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.947046 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.947348 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.947413 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:52.950475 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:52.950476 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:52.950477 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:52.950485 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:52.952339 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:52.952822 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:52.952824 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:52.952824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:52.952887 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:52.953171 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:52.953172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:52.953172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:52.953297 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:52.953374 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:52.953716 (+ 342us) server_negotiation.cc:299] Negotiation successful
0810 06:42:52.953801 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 06:42:52.954059 13353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:52.943389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:40933 (local address 127.27.41.131:43537)
0810 06:42:52.943585 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:52.943675 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:52.944345 (+ 670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:52.944609 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:52.944613 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:52.944837 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:52.945129 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:52.945136 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.945977 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.945978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:52.946937 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:52.946940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.947557 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.947559 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:52.947698 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:52.948269 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:52.948279 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:52.950376 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:52.952432 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:52.952452 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:52.952454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:52.952738 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:52.952977 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:52.952978 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:52.952978 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:52.953103 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:52.953404 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:52.953409 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:52.953564 (+ 155us) client_negotiation.cc:769] Sending connection context
0810 06:42:52.953679 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 06:42:52.953824 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":116,"threads_started":1}
I20260810 06:42:52.954555 13351 heartbeater.cc:347] Connected to a master server at 127.27.41.190:40933
I20260810 06:42:52.954646 13351 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:52.954842 13351 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
W20260810 06:42:52.956676 13351 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:40933 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 06:42:52.956779 13351 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:52.956871 13351 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
I20260810 06:42:52.957290 13351 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:52.957440 13351 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
W20260810 06:42:52.957839 13351 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 06:42:52.959187 13355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:52.947527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56834 (local address 127.27.41.190:40933)
0810 06:42:52.947991 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:52.947993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:52.948001 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:42:52.948023 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:52.948024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:52.948035 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:52.950791 (+ 2756us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:52.950844 (+ 53us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.951729 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.952907 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:52.953249 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:52.953317 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:52.955272 (+ 1955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:52.955273 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:52.955274 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:52.955280 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:52.957192 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:52.958311 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:52.958312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:52.958313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:52.958382 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:52.958643 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:52.958643 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:52.958644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:52.958741 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:52.958857 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:52.958991 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 06:42:52.959093 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":66,"threads_started":1}
Aug 10 06:42:53 dist-test-slave-bw88 krb5kdc[11219](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786344173, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:53.585038 12948 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:53.585216 12948 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
I20260810 06:42:53.585654 12648 ts_manager.cc:194] Registered new tserver with Master: 565d6eff164248409cff19a85c73d5d4 (127.27.41.129:35279)
I20260810 06:42:53.586339 12648 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:36813
I20260810 06:42:53.767086 13154 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:53.767254 13154 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
I20260810 06:42:53.767776 12648 ts_manager.cc:194] Registered new tserver with Master: 817df6dc120b4a4e9a4be10e57604b38 (127.27.41.130:35241)
I20260810 06:42:53.768290 12648 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:38527
Aug 10 06:42:53 dist-test-slave-bw88 krb5kdc[11219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344173, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for HTTP/127.27.41.148@KRBTEST.COM
I20260810 06:42:53.958022 13351 heartbeater.cc:464] Registering TS with master...
I20260810 06:42:53.958168 13351 heartbeater.cc:511] Master 127.27.41.190:40933 requested a full tablet report, sending...
I20260810 06:42:53.958467 12648 ts_manager.cc:194] Registered new tserver with Master: 0caa53e72505488689ec3698c51faab8 (127.27.41.131:44275)
I20260810 06:42:53.958949 12648 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:43537
I20260810 06:42:53.963428 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:42:53.977300 13376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:53.964475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56842 (local address 127.27.41.190:40933)
0810 06:42:53.969467 (+ 4992us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:53.969477 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:53.969579 (+ 102us) server_negotiation.cc:407] Connection header received
0810 06:42:53.969634 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:53.969635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:53.969647 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:53.969729 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:53.970483 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:53.971249 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:53.972198 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:53.972439 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:53.972520 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:53.974057 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:53.974058 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:53.974059 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:53.974066 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:53.975993 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:53.976412 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:53.976414 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:53.976414 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:53.976494 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:53.976714 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:53.976715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:53.976715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:53.976853 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:53.976956 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:53.977098 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 06:42:53.977198 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4965,"thread_start_us":70,"threads_started":1}
I20260810 06:42:53.980031 12648 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56842:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:42:53.983505 12648 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:42:53.992426 13387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:53.987890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55036 (local address 127.27.41.131:44275)
0810 06:42:53.988104 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:53.988109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:53.988201 (+ 92us) server_negotiation.cc:407] Connection header received
0810 06:42:53.988241 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:53.988243 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:53.988259 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:53.988333 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:42:53.988573 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:53.989691 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:53.991144 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:53.991925 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:53.991975 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:53.992033 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:53.992301 (+ 268us) server_negotiation.cc:299] Negotiation successful
0810 06:42:53.992343 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":86,"threads_started":1}
I20260810 06:42:53.992702 13386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:53.987492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:44275 (local address 127.0.0.1:55036)
0810 06:42:53.988080 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:53.988090 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:53.988147 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:53.988373 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:53.988376 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:53.988379 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:42:53.988449 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:53.988459 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:53.989788 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:53.989789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:53.991041 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:53.991044 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:53.992098 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:53.992099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:53.992183 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:53.992196 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 06:42:53.992562 (+ 366us) client_negotiation.cc:240] Negotiation successful
0810 06:42:53.992626 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":55,"threads_started":1}
I20260810 06:42:53.994391 13258 tablet_service.cc:1467] Processing CreateTablet for tablet ac2bb9ed5d294a86846ce59b493132ac (DEFAULT_TABLE table=test-table [id=2a4c5e04bdfd40fb9b01aa8e55d9c4be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:42:53.994827 13258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac2bb9ed5d294a86846ce59b493132ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:42:53.997152 13381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:53.987268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:35241 (local address 127.0.0.1:58186)
0810 06:42:53.987571 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:53.987612 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:53.987683 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:53.993626 (+ 5943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:53.993627 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:53.993629 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:42:53.993670 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:53.993672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:53.994944 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:53.994946 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:53.996010 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:53.996012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:53.996948 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:53.996949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:53.997012 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:53.997017 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:42:53.997047 (+ 30us) client_negotiation.cc:240] Negotiation successful
0810 06:42:53.997084 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":74,"threads_started":1}
I20260810 06:42:53.997581 13383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:53.987383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58186 (local address 127.27.41.130:35241)
0810 06:42:53.993439 (+ 6056us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:53.993444 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:53.993464 (+ 20us) server_negotiation.cc:407] Connection header received
0810 06:42:53.993500 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:53.993502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:53.993518 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:53.993739 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:42:53.993817 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:53.994846 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:53.996109 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:53.996850 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:53.997320 (+ 470us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:53.997423 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:53.997449 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 06:42:53.997506 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6014,"thread_start_us":83,"threads_started":1}
I20260810 06:42:53.998179 13050 tablet_service.cc:1467] Processing CreateTablet for tablet ac2bb9ed5d294a86846ce59b493132ac (DEFAULT_TABLE table=test-table [id=2a4c5e04bdfd40fb9b01aa8e55d9c4be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:42:53.998531 13050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac2bb9ed5d294a86846ce59b493132ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:42:54.001672 13385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:53.987622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:35279 (local address 127.0.0.1:37830)
0810 06:42:53.988439 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:53.988448 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:53.988494 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:53.988760 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:53.988760 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:53.988762 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:42:53.988803 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:53.988804 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:53.998964 (+ 10160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:53.998965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:54.000155 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:54.000158 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:54.001432 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:54.001433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:54.001497 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:54.001502 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:42:54.001549 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 06:42:54.001590 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":801,"thread_start_us":52,"threads_started":1}
I20260810 06:42:54.002050 13388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:53.987902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37830 (local address 127.27.41.129:35279)
0810 06:42:53.988159 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:53.988163 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:53.988568 (+ 405us) server_negotiation.cc:407] Connection header received
0810 06:42:53.988608 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:53.988610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:53.988625 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:53.988689 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:42:53.988879 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:53.998864 (+ 9985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:54.000256 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:54.001276 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:54.001815 (+ 539us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:54.001887 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:54.001915 (+ 28us) server_negotiation.cc:299] Negotiation successful
0810 06:42:54.001962 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":96,"threads_started":1}
I20260810 06:42:54.002395 13392 tablet_bootstrap.cc:492] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38: Bootstrap starting.
I20260810 06:42:54.002429 13390 tablet_bootstrap.cc:492] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8: Bootstrap starting.
I20260810 06:42:54.002722 12843 tablet_service.cc:1467] Processing CreateTablet for tablet ac2bb9ed5d294a86846ce59b493132ac (DEFAULT_TABLE table=test-table [id=2a4c5e04bdfd40fb9b01aa8e55d9c4be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:42:54.003094 13392 tablet_bootstrap.cc:654] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38: Neither blocks nor log segments found. Creating new log.
I20260810 06:42:54.003101 13390 tablet_bootstrap.cc:654] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8: Neither blocks nor log segments found. Creating new log.
I20260810 06:42:54.003101 12843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac2bb9ed5d294a86846ce59b493132ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:42:54.003422 13390 log.cc:824] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8: Log is configured to *not* fsync() on all Append() calls
I20260810 06:42:54.003439 13392 log.cc:824] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38: Log is configured to *not* fsync() on all Append() calls
I20260810 06:42:54.004246 13390 tablet_bootstrap.cc:492] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8: No bootstrap required, opened a new log
I20260810 06:42:54.004246 13392 tablet_bootstrap.cc:492] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38: No bootstrap required, opened a new log
I20260810 06:42:54.004320 13392 ts_tablet_manager.cc:1397] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:42:54.004323 13390 ts_tablet_manager.cc:1397] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:42:54.006625 13392 raft_consensus.cc:348] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817df6dc120b4a4e9a4be10e57604b38" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35241 } } peers { permanent_uuid: "0caa53e72505488689ec3698c51faab8" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44275 } } peers { permanent_uuid: "565d6eff164248409cff19a85c73d5d4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 35279 } }
I20260810 06:42:54.006799 13392 raft_consensus.cc:374] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:42:54.006850 13392 raft_consensus.cc:729] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 817df6dc120b4a4e9a4be10e57604b38, State: Initialized, Role: FOLLOWER
I20260810 06:42:54.006959 13392 consensus_queue.cc:260] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817df6dc120b4a4e9a4be10e57604b38" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35241 } } peers { permanent_uuid: "0caa53e72505488689ec3698c51faab8" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44275 } } peers { permanent_uuid: "565d6eff164248409cff19a85c73d5d4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 35279 } }
I20260810 06:42:54.006912 13390 raft_consensus.cc:348] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817df6dc120b4a4e9a4be10e57604b38" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35241 } } peers { permanent_uuid: "0caa53e72505488689ec3698c51faab8" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44275 } } peers { permanent_uuid: "565d6eff164248409cff19a85c73d5d4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 35279 } }
I20260810 06:42:54.007076 13390 raft_consensus.cc:374] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:42:54.007112 13390 raft_consensus.cc:729] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0caa53e72505488689ec3698c51faab8, State: Initialized, Role: FOLLOWER
I20260810 06:42:54.007215 13392 ts_tablet_manager.cc:1428] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260810 06:42:54.007526 13155 tablet.cc:2369] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:42:54.007736 13154 heartbeater.cc:503] Master 127.27.41.190:40933 was elected leader, sending a full tablet report...
I20260810 06:42:54.008013 13390 consensus_queue.cc:260] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817df6dc120b4a4e9a4be10e57604b38" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35241 } } peers { permanent_uuid: "0caa53e72505488689ec3698c51faab8" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44275 } } peers { permanent_uuid: "565d6eff164248409cff19a85c73d5d4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 35279 } }
I20260810 06:42:54.008275 13390 ts_tablet_manager.cc:1428] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 06:42:54.008388 13351 heartbeater.cc:503] Master 127.27.41.190:40933 was elected leader, sending a full tablet report...
I20260810 06:42:54.009505 13395 tablet_bootstrap.cc:492] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4: Bootstrap starting.
I20260810 06:42:54.010161 13395 tablet_bootstrap.cc:654] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4: Neither blocks nor log segments found. Creating new log.
I20260810 06:42:54.010485 13395 log.cc:824] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4: Log is configured to *not* fsync() on all Append() calls
I20260810 06:42:54.011394 13395 tablet_bootstrap.cc:492] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4: No bootstrap required, opened a new log
I20260810 06:42:54.011475 13395 ts_tablet_manager.cc:1397] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:42:54.013617 13395 raft_consensus.cc:348] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817df6dc120b4a4e9a4be10e57604b38" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35241 } } peers { permanent_uuid: "0caa53e72505488689ec3698c51faab8" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44275 } } peers { permanent_uuid: "565d6eff164248409cff19a85c73d5d4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 35279 } }
I20260810 06:42:54.013775 13395 raft_consensus.cc:374] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:42:54.013806 13395 raft_consensus.cc:729] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 565d6eff164248409cff19a85c73d5d4, State: Initialized, Role: FOLLOWER
I20260810 06:42:54.013936 13395 consensus_queue.cc:260] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817df6dc120b4a4e9a4be10e57604b38" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35241 } } peers { permanent_uuid: "0caa53e72505488689ec3698c51faab8" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44275 } } peers { permanent_uuid: "565d6eff164248409cff19a85c73d5d4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 35279 } }
I20260810 06:42:54.014174 13395 ts_tablet_manager.cc:1428] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:42:54.014216 12948 heartbeater.cc:503] Master 127.27.41.190:40933 was elected leader, sending a full tablet report...
I20260810 06:42:54.038772 13399 raft_consensus.cc:482] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:42:54.038913 13399 raft_consensus.cc:504] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817df6dc120b4a4e9a4be10e57604b38" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35241 } } peers { permanent_uuid: "0caa53e72505488689ec3698c51faab8" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44275 } } peers { permanent_uuid: "565d6eff164248409cff19a85c73d5d4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 35279 } }
I20260810 06:42:54.039275 13399 leader_election.cc:288] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 817df6dc120b4a4e9a4be10e57604b38 (127.27.41.130:35241), 565d6eff164248409cff19a85c73d5d4 (127.27.41.129:35279)
I20260810 06:42:54.043428 13383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:54.039545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:53671 (local address 127.27.41.130:35241)
0810 06:42:54.039588 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:54.039590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:54.039787 (+ 197us) server_negotiation.cc:407] Connection header received
0810 06:42:54.039881 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:54.039882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:54.039891 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:54.039919 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:42:54.040130 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:54.040829 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:54.042445 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:54.042949 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:54.043014 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:54.043024 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:54.043319 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 06:42:54.043361 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 06:42:54.043546 13388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:54.039789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:59171 (local address 127.27.41.129:35279)
0810 06:42:54.039830 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:54.039832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:54.039937 (+ 105us) server_negotiation.cc:407] Connection header received
0810 06:42:54.040051 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:54.040052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:54.040072 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:54.040100 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:42:54.040304 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:54.041049 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:54.042478 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:54.043053 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:54.043105 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:54.043116 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:54.043436 (+ 320us) server_negotiation.cc:299] Negotiation successful
0810 06:42:54.043482 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:42:54.043794 13404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:54.039641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:35279 (local address 127.27.41.131:59171)
0810 06:42:54.039879 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:54.039889 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:54.039962 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:54.040161 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:54.040161 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:54.040163 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:42:54.040231 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:54.040233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:54.041208 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:54.041209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:54.042346 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:54.042350 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:54.043216 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:54.043217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:54.043322 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:54.043326 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:42:54.043664 (+ 338us) client_negotiation.cc:240] Negotiation successful
0810 06:42:54.043709 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":59,"threads_started":1}
I20260810 06:42:54.044062 13403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:54.039452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:35241 (local address 127.27.41.131:53671)
0810 06:42:54.039723 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:54.039735 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:54.039813 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:54.039981 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:54.039981 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:54.039983 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:42:54.040072 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:54.040074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:54.040946 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:54.040947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:54.042303 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:54.042306 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:54.043114 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:54.043115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:54.043184 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:54.043221 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 06:42:54.043817 (+ 596us) client_negotiation.cc:240] Negotiation successful
0810 06:42:54.043986 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":63,"thread_start_us":94,"threads_started":1}
I20260810 06:42:54.044140 12870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac2bb9ed5d294a86846ce59b493132ac" candidate_uuid: "0caa53e72505488689ec3698c51faab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565d6eff164248409cff19a85c73d5d4" is_pre_election: true
I20260810 06:42:54.044293 12870 raft_consensus.cc:2454] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0caa53e72505488689ec3698c51faab8 in term 0.
I20260810 06:42:54.044553 13189 leader_election.cc:302] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0caa53e72505488689ec3698c51faab8, 565d6eff164248409cff19a85c73d5d4; no voters:
I20260810 06:42:54.044584 13084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac2bb9ed5d294a86846ce59b493132ac" candidate_uuid: "0caa53e72505488689ec3698c51faab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "817df6dc120b4a4e9a4be10e57604b38" is_pre_election: true
I20260810 06:42:54.044687 13399 raft_consensus.cc:2781] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:42:54.044730 13399 raft_consensus.cc:482] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:42:54.044726 13084 raft_consensus.cc:2454] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0caa53e72505488689ec3698c51faab8 in term 0.
I20260810 06:42:54.044751 13399 raft_consensus.cc:3037] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:42:54.045703 13399 raft_consensus.cc:504] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817df6dc120b4a4e9a4be10e57604b38" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35241 } } peers { permanent_uuid: "0caa53e72505488689ec3698c51faab8" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44275 } } peers { permanent_uuid: "565d6eff164248409cff19a85c73d5d4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 35279 } }
I20260810 06:42:54.045840 13399 leader_election.cc:288] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [CANDIDATE]: Term 1 election: Requested vote from peers 817df6dc120b4a4e9a4be10e57604b38 (127.27.41.130:35241), 565d6eff164248409cff19a85c73d5d4 (127.27.41.129:35279)
I20260810 06:42:54.046092 13084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac2bb9ed5d294a86846ce59b493132ac" candidate_uuid: "0caa53e72505488689ec3698c51faab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "817df6dc120b4a4e9a4be10e57604b38"
I20260810 06:42:54.046108 12870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac2bb9ed5d294a86846ce59b493132ac" candidate_uuid: "0caa53e72505488689ec3698c51faab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565d6eff164248409cff19a85c73d5d4"
I20260810 06:42:54.046175 13084 raft_consensus.cc:3037] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:42:54.046186 12870 raft_consensus.cc:3037] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:42:54.047044 13084 raft_consensus.cc:2454] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0caa53e72505488689ec3698c51faab8 in term 1.
I20260810 06:42:54.047082 12870 raft_consensus.cc:2454] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0caa53e72505488689ec3698c51faab8 in term 1.
I20260810 06:42:54.047307 13189 leader_election.cc:302] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0caa53e72505488689ec3698c51faab8, 565d6eff164248409cff19a85c73d5d4; no voters:
I20260810 06:42:54.047438 13399 raft_consensus.cc:2781] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:42:54.047621 13399 raft_consensus.cc:686] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [term 1 LEADER]: Becoming Leader. State: Replica: 0caa53e72505488689ec3698c51faab8, State: Running, Role: LEADER
I20260810 06:42:54.047708 13399 consensus_queue.cc:237] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817df6dc120b4a4e9a4be10e57604b38" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35241 } } peers { permanent_uuid: "0caa53e72505488689ec3698c51faab8" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44275 } } peers { permanent_uuid: "565d6eff164248409cff19a85c73d5d4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 35279 } }
I20260810 06:42:54.048448 12648 catalog_manager.cc:5495] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0caa53e72505488689ec3698c51faab8 (127.27.41.131). New cstate: current_term: 1 leader_uuid: "0caa53e72505488689ec3698c51faab8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "817df6dc120b4a4e9a4be10e57604b38" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0caa53e72505488689ec3698c51faab8" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 44275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "565d6eff164248409cff19a85c73d5d4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 35279 } health_report { overall_health: UNKNOWN } } }
I20260810 06:42:54.067569 13387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:54.064519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55048 (local address 127.27.41.131:44275)
0810 06:42:54.064563 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:54.064566 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:54.064575 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:42:54.064637 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:54.064638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:54.064660 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:54.064736 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:42:54.064884 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:54.065665 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:54.066695 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:54.066978 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:54.067056 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:54.067221 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:42:54.067342 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:42:54.067427 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:54.067477 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 06:42:54.067501 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 06:42:54.069659 12870 raft_consensus.cc:1261] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4 [term 1 FOLLOWER]: Refusing update from remote peer 0caa53e72505488689ec3698c51faab8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:42:54.069698 13084 raft_consensus.cc:1261] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38 [term 1 FOLLOWER]: Refusing update from remote peer 0caa53e72505488689ec3698c51faab8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260810 06:42:54.069294 12949 tablet.cc:2369] T ac2bb9ed5d294a86846ce59b493132ac P 565d6eff164248409cff19a85c73d5d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:42:54.070044 13405 consensus_queue.cc:1035] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "565d6eff164248409cff19a85c73d5d4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 35279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:42:54.070194 13405 consensus_queue.cc:1035] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "817df6dc120b4a4e9a4be10e57604b38" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 35241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:42:54.076730 12648 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:42:54.076826 12648 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:42:54.077685 12648 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 403b6df794c34ba0abba0cd35f8bd3d5: Sending DeleteTablet for 3 replicas of tablet ac2bb9ed5d294a86846ce59b493132ac
I20260810 06:42:54.078064 13050 tablet_service.cc:1514] Processing DeleteTablet for tablet ac2bb9ed5d294a86846ce59b493132ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:42:54 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:58186
I20260810 06:42:54.078378 13258 tablet_service.cc:1514] Processing DeleteTablet for tablet ac2bb9ed5d294a86846ce59b493132ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:42:54 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:55036
I20260810 06:42:54.078528 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 12702
I20260810 06:42:54.078574 13257 tablet_service.cc:1514] Processing DeleteTablet for tablet ac2bb9ed5d294a86846ce59b493132ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:42:54 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:55036
I20260810 06:42:54.085727 13417 mvcc.cc:205] Tried to move back new op lower bound from 7316865736985550848 to 7316865736900042752. Current Snapshot: MvccSnapshot[applied={T|T < 7316865736985550848}]
I20260810 06:42:54.085940 13427 tablet_replica.cc:330] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8: stopping tablet replica
I20260810 06:42:54.086067 13427 raft_consensus.cc:2229] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:42:54.086174 13427 raft_consensus.cc:2258] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:42:54.096364 13425 tablet_replica.cc:330] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38: stopping tablet replica
I20260810 06:42:54.096506 13425 raft_consensus.cc:2229] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:42:54.096614 13425 raft_consensus.cc:2258] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:42:54.097285 13427 ts_tablet_manager.cc:1905] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:42:54.099411 13427 ts_tablet_manager.cc:1918] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:42:54.099574 13427 log.cc:1196] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/ac2bb9ed5d294a86846ce59b493132ac
I20260810 06:42:54.099956 13427 ts_tablet_manager.cc:1939] T ac2bb9ed5d294a86846ce59b493132ac P 0caa53e72505488689ec3698c51faab8: Deleting consensus metadata
I20260810 06:42:54.100543 12627 catalog_manager.cc:4841] TS 0caa53e72505488689ec3698c51faab8 (127.27.41.131:44275): tablet ac2bb9ed5d294a86846ce59b493132ac (table test-table [id=2a4c5e04bdfd40fb9b01aa8e55d9c4be]) successfully deleted
I20260810 06:42:54.100812 13425 ts_tablet_manager.cc:1905] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 06:42:54.101024 12627 catalog_manager.cc:4808] TS 0caa53e72505488689ec3698c51faab8 (127.27.41.131:44275): delete failed for tablet ac2bb9ed5d294a86846ce59b493132ac because the tablet was not found. No further retry: Not found: Tablet not found: ac2bb9ed5d294a86846ce59b493132ac
I20260810 06:42:54.102639 13425 ts_tablet_manager.cc:1918] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:42:54.102721 13425 log.cc:1196] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/ac2bb9ed5d294a86846ce59b493132ac
I20260810 06:42:54.103010 13425 ts_tablet_manager.cc:1939] T ac2bb9ed5d294a86846ce59b493132ac P 817df6dc120b4a4e9a4be10e57604b38: Deleting consensus metadata
I20260810 06:42:54.103458 12627 catalog_manager.cc:4841] TS 817df6dc120b4a4e9a4be10e57604b38 (127.27.41.130:35241): tablet ac2bb9ed5d294a86846ce59b493132ac (table test-table [id=2a4c5e04bdfd40fb9b01aa8e55d9c4be]) successfully deleted
W20260810 06:42:54.104225 12627 connection.cc:535] client connection to 127.27.41.129:35279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 06:42:54.104326 12627 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 06:42:54.104892 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 12955
I20260810 06:42:54.117259 13385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:54.117094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:35279 (local address 127.0.0.1:37836)
0810 06:42:54.117149 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:54.117212 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:35279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 06:42:54.117755 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 13157
W20260810 06:42:54.149328 12627 catalog_manager.cc:4584] TS 565d6eff164248409cff19a85c73d5d4 (127.27.41.129:35279): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ac2bb9ed5d294a86846ce59b493132ac: Network error: Client connection negotiation failed: client connection to 127.27.41.129:35279: connect: Connection refused (error 111)
I20260810 06:42:54.157526 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 12598
I20260810 06:42:54.168866 27814 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 06:42:54.514619 27814 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 06:42:54.514712 27814 mini_ranger.cc:66] Stopping Ranger...
I20260810 06:42:54.870164 27814 mini_ranger.cc:68] Stopped Ranger
2026-08-10 06:42:54.870 UTC [11255] LOG: received smart shutdown request
2026-08-10 06:42:54.875 UTC [11255] LOG: background worker "logical replication launcher" (PID 11267) exited with exit code 1
2026-08-10 06:42:54.875 UTC [11260] LOG: shutting down
2026-08-10 06:42:55.033 UTC [11255] LOG: database system is shut down
2026-08-10T06:42:55Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49442 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:42:55 dist-test-slave-bw88 krb5kdc[13444](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:42:55 dist-test-slave-bw88 krb5kdc[13444](info): set up 2 sockets
Aug 10 06:42:55 dist-test-slave-bw88 krb5kdc[13444](info): commencing operation
krb5kdc: starting...
W20260810 06:42:56.374883 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:42:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:42:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:42:56.496290 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:34957
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:45783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:34957,127.27.41.189:41705,127.27.41.188:42633
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:42:56.578171 13467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:56.578387 13467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:56.578409 13467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:56.579587 13467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:42:56.579627 13467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:56.579640 13467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:56.579653 13467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:42:56.579699 13467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:42:56.581133 13467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:45783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:34957,127.27.41.189:41705,127.27.41.188:42633
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:34957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:56.581449 13467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:56.581678 13467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:56.586575 13475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:56.586630 13473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:56.586618 13467 server_base.cc:1034] running on GCE node
W20260810 06:42:56.586580 13478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:56.586992 13467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:56.587307 13467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:56.588466 13467 hybrid_clock.cc:648] HybridClock initialized: now 1786344176588463 us; error 35 us; skew 500 ppm
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:56.590862 13467 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:42:56.591327 13467 webserver.cc:460] Webserver started at http://127.27.41.190:45711/ using document root <none> and password file <none>
I20260810 06:42:56.591500 13467 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:56.591538 13467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:42:56.591622 13467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:42:56.592555 13467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "0c026d158ddf47efa921ce4b764f0868"
format_stamp: "Formatted at 2026-08-10 06:42:56 on dist-test-slave-bw88"
server_key: "89ac2f3277cb7f230c13b6948f1481be"
server_key_iv: "a6efb6f012f1d10815e3831a863acca1"
server_key_version: "encryptionkey@0"
I20260810 06:42:56.592844 13467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "0c026d158ddf47efa921ce4b764f0868"
format_stamp: "Formatted at 2026-08-10 06:42:56 on dist-test-slave-bw88"
server_key: "89ac2f3277cb7f230c13b6948f1481be"
server_key_iv: "a6efb6f012f1d10815e3831a863acca1"
server_key_version: "encryptionkey@0"
I20260810 06:42:56.594219 13467 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:42:56.594975 13486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:56.595170 13467 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:42:56.595268 13467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "0c026d158ddf47efa921ce4b764f0868"
format_stamp: "Formatted at 2026-08-10 06:42:56 on dist-test-slave-bw88"
server_key: "89ac2f3277cb7f230c13b6948f1481be"
server_key_iv: "a6efb6f012f1d10815e3831a863acca1"
server_key_version: "encryptionkey@0"
I20260810 06:42:56.595338 13467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:56.622846 13467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:56.624823 13467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:56.624980 13467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:56.629354 13467 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:34957
I20260810 06:42:56.629438 13556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:34957 every 8 connection(s)
I20260810 06:42:56.629761 13467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:42:56.630716 13558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:42:56.631569 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 13467
I20260810 06:42:56.631675 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:42:56.631894 27814 external_mini_cluster.cc:1428] Setting key a38605185de1550926399cbea53eab94
I20260810 06:42:56.632652 13558 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.41.189@KRBTEST.COM; defaulting to no policy
I20260810 06:42:56.644073 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.633424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34957 (local address 127.0.0.1:44506)
0810 06:42:56.633613 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.633651 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:56.634408 (+ 757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:56.634759 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:56.634762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:56.635176 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:56.635402 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.635409 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.636573 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.636575 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.637778 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.637782 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.638293 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.638294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.638390 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.638929 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:56.638942 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:56.640524 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:56.642637 (+ 2113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.642644 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.642645 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.642830 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.643136 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.643137 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.643138 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.643242 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.643601 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:56.643607 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:56.643661 (+ 54us) client_negotiation.cc:769] Sending connection context
0810 06:42:56.643732 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 06:42:56.643852 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":84,"threads_started":1}
I20260810 06:42:56.644078 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.633625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44506 (local address 127.27.41.190:34957)
0810 06:42:56.633960 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.633964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.633993 (+ 29us) server_negotiation.cc:407] Connection header received
0810 06:42:56.634599 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.634601 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.634626 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.634695 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.635504 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.636482 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.637869 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.638197 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.638278 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.640628 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.640649 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.640649 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.640657 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.642559 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.642920 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.642923 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.642923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.643058 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.643305 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.643305 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.643306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.643512 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.643604 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.643787 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.643917 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":308,"thread_start_us":73,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.189@KRBTEST.COM" created.
I20260810 06:42:56.644942 13558 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:42:56.645296 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.645178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41705 (local address 127.0.0.1:44492)
0810 06:42:56.645225 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.645268 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 06:42:56.645504 13490 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41705: connect: Connection refused (error 111)
I20260810 06:42:56.645888 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.645804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41705 (local address 127.0.0.1:44500)
0810 06:42:56.645849 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.645874 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 06:42:56.646574 13558 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.189:41705: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41705: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.189.keytab.
Entry for principal kudu/127.27.41.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.189.keytab.
I20260810 06:42:56.659693 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.189:41705
--webserver_interface=127.27.41.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.189.keytab
--principal=kudu/127.27.41.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:45783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:34957,127.27.41.189:41705,127.27.41.188:42633
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:42:56.695803 13558 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } attempt: 1
I20260810 06:42:56.696357 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.696227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41705 (local address 127.0.0.1:44514)
0810 06:42:56.696289 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.696327 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 06:42:56.696717 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.696621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41705 (local address 127.0.0.1:44522)
0810 06:42:56.696666 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.696691 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 06:42:56.696806 13558 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.189:41705: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41705: connect: Connection refused (error 111)
W20260810 06:42:56.741246 13568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:56.741503 13568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:56.741542 13568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:56.742646 13568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:42:56.742710 13568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:56.742733 13568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:56.742753 13568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:42:56.742780 13568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:42:56.744262 13568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:45783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:34957,127.27.41.189:41705,127.27.41.188:42633
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.189.keytab
--principal=kudu/127.27.41.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.189:41705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.41.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:56.744544 13568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:56.744787 13568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:56.749696 13577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:56.749792 13576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:56.749851 13568 server_base.cc:1034] running on GCE node
W20260810 06:42:56.749989 13579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:56.750228 13568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:56.750536 13568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:56.751703 13568 hybrid_clock.cc:648] HybridClock initialized: now 1786344176751695 us; error 41 us; skew 500 ppm
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:56.754362 13568 init.cc:377] Logged in from keytab as kudu/127.27.41.189@KRBTEST.COM (short username kudu)
I20260810 06:42:56.754738 13568 webserver.cc:460] Webserver started at http://127.27.41.189:45687/ using document root <none> and password file <none>
I20260810 06:42:56.754906 13568 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:56.754942 13568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:42:56.755023 13568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:42:56.755954 13568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/data/instance:
uuid: "f8540e0de92e44ba9158e891bc9eacc2"
format_stamp: "Formatted at 2026-08-10 06:42:56 on dist-test-slave-bw88"
server_key: "12f096e771938b0ac502b6ab1e6c3bb0"
server_key_iv: "158a35dd01f452a5914cab5710ddf378"
server_key_version: "encryptionkey@0"
I20260810 06:42:56.756263 13568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/wal/instance:
uuid: "f8540e0de92e44ba9158e891bc9eacc2"
format_stamp: "Formatted at 2026-08-10 06:42:56 on dist-test-slave-bw88"
server_key: "12f096e771938b0ac502b6ab1e6c3bb0"
server_key_iv: "158a35dd01f452a5914cab5710ddf378"
server_key_version: "encryptionkey@0"
I20260810 06:42:56.757501 13568 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:42:56.758173 13589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:56.758342 13568 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:56.758412 13568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/wal
uuid: "f8540e0de92e44ba9158e891bc9eacc2"
format_stamp: "Formatted at 2026-08-10 06:42:56 on dist-test-slave-bw88"
server_key: "12f096e771938b0ac502b6ab1e6c3bb0"
server_key_iv: "158a35dd01f452a5914cab5710ddf378"
server_key_version: "encryptionkey@0"
I20260810 06:42:56.758462 13568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:56.764962 13558 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } attempt: 2
I20260810 06:42:56.765317 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.765200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41705 (local address 127.0.0.1:44534)
0810 06:42:56.765257 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.765291 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 06:42:56.765705 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.765624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41705 (local address 127.0.0.1:44540)
0810 06:42:56.765666 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.765690 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 06:42:56.765805 13558 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.189:41705: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41705: connect: Connection refused (error 111)
I20260810 06:42:56.781621 13568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:56.783985 13568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:56.784152 13568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:56.788210 13568 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.189:41705
I20260810 06:42:56.788282 13659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.189:41705 every 8 connection(s)
I20260810 06:42:56.788591 13568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/data/info.pb
I20260810 06:42:56.789568 13660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:42:56.791102 13660 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:42:56.794814 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 13568
I20260810 06:42:56.794952 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-1/wal/instance
I20260810 06:42:56.795163 27814 external_mini_cluster.cc:1428] Setting key 38dabccd5bb9a120ef289c813446119a
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.189@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:42:56.800760 13664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.791778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34957 (local address 127.0.0.1:44516)
0810 06:42:56.791949 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.791983 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:56.792457 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:56.792681 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:56.792683 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:56.792903 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:56.793111 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.793114 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.793869 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.793870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.794646 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.794648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.795191 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.795192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.795342 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.795787 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:56.795802 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:56.797434 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:56.799389 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.799396 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.799398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.799627 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.799882 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.799883 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.799883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.800008 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.800302 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:56.800306 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:56.800411 (+ 105us) client_negotiation.cc:769] Sending connection context
0810 06:42:56.800503 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 06:42:56.800614 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":91,"threads_started":1}
I20260810 06:42:56.800755 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.791786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44516 (local address 127.27.41.190:34957)
0810 06:42:56.791833 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.791835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.792066 (+ 231us) server_negotiation.cc:407] Connection header received
0810 06:42:56.792541 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.792542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.792558 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.792620 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.793202 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.793782 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.794750 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.795094 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.795181 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.797524 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.797525 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.797526 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.797533 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.799297 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.799710 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.799711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.799712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.799777 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.800082 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.800083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.800083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.800231 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.800305 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.800554 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.800648 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:42:56.801481 13660 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.27.41.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.188@KRBTEST.COM" created.
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.189@KRBTEST.COM for kudu/127.27.41.189@KRBTEST.COM
I20260810 06:42:56.811184 13664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.801712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41705 (local address 127.0.0.1:44542)
0810 06:42:56.801759 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.801769 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:56.801809 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:56.802121 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:56.802122 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:56.802231 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:56.802277 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.802278 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.803577 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.803577 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.804068 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.804070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.804712 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.804713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.804804 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.805185 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:56.805189 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:56.808174 (+ 2985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:56.810191 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.810192 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.810192 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.810350 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.810552 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.810552 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.810553 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.810603 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.810940 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:56.810941 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:56.810977 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 06:42:56.811021 (+ 44us) client_negotiation.cc:240] Negotiation successful
0810 06:42:56.811092 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 06:42:56.811381 13667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.801767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44542 (local address 127.27.41.189:41705)
0810 06:42:56.801933 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.801938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.801963 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:42:56.801989 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.801991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.802006 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.802112 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.802351 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.803479 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.804155 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.804608 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.804693 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.808264 (+ 3571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.808272 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.808272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.808278 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.810109 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.810415 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.810418 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.810418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.810481 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.810667 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.810668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.810669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.810863 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.810951 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.811077 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.811186 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":85,"threads_started":1}
I20260810 06:42:56.812048 13660 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:42:56.812400 13664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.812285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:42633 (local address 127.0.0.1:60166)
0810 06:42:56.812334 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.812382 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 06:42:56.812597 13591 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
I20260810 06:42:56.813119 13664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.812956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:42633 (local address 127.0.0.1:60168)
0810 06:42:56.813056 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.813097 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260810 06:42:56.813308 13660 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:42633: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.188.keytab.
Entry for principal kudu/127.27.41.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.188.keytab.
I20260810 06:42:56.822259 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.188:42633
--webserver_interface=127.27.41.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.188.keytab
--principal=kudu/127.27.41.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:45783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:34957,127.27.41.189:41705,127.27.41.188:42633
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:42:56.856952 13558 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } attempt: 3
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for kudu/127.27.41.189@KRBTEST.COM
I20260810 06:42:56.862600 13660 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } attempt: 1
I20260810 06:42:56.863075 13664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.862859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:42633 (local address 127.0.0.1:60174)
0810 06:42:56.862998 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.863035 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260810 06:42:56.863845 13664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.863743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:42633 (local address 127.0.0.1:60184)
0810 06:42:56.863792 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.863824 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 06:42:56.864084 13660 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:42633: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
I20260810 06:42:56.864625 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.857301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41705 (local address 127.0.0.1:44548)
0810 06:42:56.857378 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.857391 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:56.857444 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:56.857644 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:56.857645 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:56.857786 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:56.857852 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.857854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.858826 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.858827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.859295 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.859296 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.859758 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.859759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.859812 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.860342 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:56.860347 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:56.861928 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:56.863602 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.863603 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.863604 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.863822 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.864042 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.864043 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.864043 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.864112 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.864390 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:56.864391 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:56.864433 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 06:42:56.864490 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 06:42:56.864564 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 06:42:56.864696 13667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.857417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44548 (local address 127.27.41.189:41705)
0810 06:42:56.857489 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.857491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.857504 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:42:56.857536 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.857537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.857549 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.857631 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.857934 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.858742 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.859374 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.859687 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.859756 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.862016 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.862017 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.862018 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.862024 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.863518 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.863903 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.863904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.863904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.863966 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.864192 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.864194 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.864194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.864323 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.864384 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.864534 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.864614 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 06:42:56.865183 13558 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:42:56.865482 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.865410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:42633 (local address 127.0.0.1:60192)
0810 06:42:56.865437 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.865462 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260810 06:42:56.865805 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.865710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:42633 (local address 127.0.0.1:60206)
0810 06:42:56.865761 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.865784 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 06:42:56.865929 13558 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:42633: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
I20260810 06:42:56.897070 13558 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } attempt: 1
I20260810 06:42:56.897544 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.897420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:42633 (local address 127.0.0.1:60216)
0810 06:42:56.897476 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.897514 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 06:42:56.897894 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.897801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:42633 (local address 127.0.0.1:60232)
0810 06:42:56.897848 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.897871 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 06:42:56.897985 13558 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:42633: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
W20260810 06:42:56.905530 13671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:56.905721 13671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:56.905756 13671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:56.906873 13671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:42:56.906911 13671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:56.906925 13671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:56.906975 13671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:42:56.906991 13671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:42:56.908463 13671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:45783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:34957,127.27.41.189:41705,127.27.41.188:42633
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.188.keytab
--principal=kudu/127.27.41.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.188:42633
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.41.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:56.908716 13671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:56.908943 13671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:56.913975 13677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:56.914016 13671 server_base.cc:1034] running on GCE node
W20260810 06:42:56.913954 13683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:56.913946 13680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:56.914387 13671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:56.914690 13671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:56.915830 13671 hybrid_clock.cc:648] HybridClock initialized: now 1786344176915821 us; error 31 us; skew 500 ppm
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:56.918448 13671 init.cc:377] Logged in from keytab as kudu/127.27.41.188@KRBTEST.COM (short username kudu)
I20260810 06:42:56.918921 13671 webserver.cc:460] Webserver started at http://127.27.41.188:35453/ using document root <none> and password file <none>
I20260810 06:42:56.919144 13671 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:56.919353 13671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:42:56.919530 13671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:42:56.920571 13671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/data/instance:
uuid: "c6ac7716b0fc407586c7a238138ab5a1"
format_stamp: "Formatted at 2026-08-10 06:42:56 on dist-test-slave-bw88"
server_key: "6c53802c219c9eaf65785986b83ecc74"
server_key_iv: "a374a906d107ba95fe01ce75897b68cd"
server_key_version: "encryptionkey@0"
I20260810 06:42:56.920938 13671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/wal/instance:
uuid: "c6ac7716b0fc407586c7a238138ab5a1"
format_stamp: "Formatted at 2026-08-10 06:42:56 on dist-test-slave-bw88"
server_key: "6c53802c219c9eaf65785986b83ecc74"
server_key_iv: "a374a906d107ba95fe01ce75897b68cd"
server_key_version: "encryptionkey@0"
I20260810 06:42:56.922358 13671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:42:56.923113 13693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:56.923298 13671 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:42:56.923405 13671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/wal
uuid: "c6ac7716b0fc407586c7a238138ab5a1"
format_stamp: "Formatted at 2026-08-10 06:42:56 on dist-test-slave-bw88"
server_key: "6c53802c219c9eaf65785986b83ecc74"
server_key_iv: "a374a906d107ba95fe01ce75897b68cd"
server_key_version: "encryptionkey@0"
I20260810 06:42:56.923478 13671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:56.932255 13660 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } attempt: 2
I20260810 06:42:56.932657 13664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.932530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:42633 (local address 127.0.0.1:60240)
0810 06:42:56.932592 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.932628 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 06:42:56.932999 13664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.932897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:42633 (local address 127.0.0.1:60246)
0810 06:42:56.932948 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.932979 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 06:42:56.933003 13671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
W20260810 06:42:56.933089 13660 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:42633: Network error: Client connection negotiation failed: client connection to 127.27.41.188:42633: connect: Connection refused (error 111)
I20260810 06:42:56.934898 13671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:56.935060 13671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:56.939307 13671 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.188:42633
I20260810 06:42:56.939371 13763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.188:42633 every 8 connection(s)
I20260810 06:42:56.939702 13671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/data/info.pb
I20260810 06:42:56.940570 13764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:42:56.942189 13764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:42:56.947079 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 13671
I20260810 06:42:56.947220 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786344020082892-27814-0/minicluster-data/master-2/wal/instance
I20260810 06:42:56.947405 27814 external_mini_cluster.cc:1428] Setting key 4679aa060bb6b4854f5273ac9214e65e
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.188@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:42:56.951277 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.942884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44532 (local address 127.27.41.190:34957)
0810 06:42:56.942967 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.942970 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.943074 (+ 104us) server_negotiation.cc:407] Connection header received
0810 06:42:56.943526 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.943527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.943538 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.943583 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.944157 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.944628 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.945674 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.945869 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.945924 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.948286 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.948288 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.948288 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.948295 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.949801 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.950222 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.950224 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.950224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.950299 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.950556 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.950557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.950557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.950671 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.950742 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.951068 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.951175 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:42:56.951359 13766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.942783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:34957 (local address 127.0.0.1:44532)
0810 06:42:56.942950 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.942994 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:56.943415 (+ 421us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:56.943647 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:56.943650 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:56.943882 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:56.944079 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.944083 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.944723 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.944725 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.945601 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.945603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.945950 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.945951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.946050 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.946531 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:56.946539 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:56.948190 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:56.949901 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.949909 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.949911 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.950125 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.950368 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.950369 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.950370 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.950484 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.950747 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:56.950754 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:56.950880 (+ 126us) client_negotiation.cc:769] Sending connection context
0810 06:42:56.951009 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 06:42:56.951162 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
I20260810 06:42:56.951984 13764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.188@KRBTEST.COM
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.188@KRBTEST.COM for kudu/127.27.41.189@KRBTEST.COM
I20260810 06:42:56.956317 13769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.947827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60248 (local address 127.27.41.188:42633)
0810 06:42:56.947985 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.947989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.948044 (+ 55us) server_negotiation.cc:407] Connection header received
0810 06:42:56.948107 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.948110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.948131 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.948212 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.948840 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.949602 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.950329 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.950613 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.950693 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.953282 (+ 2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.953288 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.953289 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.953294 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.955153 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.955482 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.955486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.955486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.955541 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.955754 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.955754 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.955755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.955870 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.955972 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.956129 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.956204 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":76,"threads_started":1}
I20260810 06:42:56.959275 13766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.952208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41705 (local address 127.0.0.1:44552)
0810 06:42:56.952254 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.952263 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:56.952296 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:56.952445 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:56.952445 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:56.952549 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:56.952589 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.952590 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.953441 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.953442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.954278 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.954281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.954616 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.954617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.954687 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.954984 (+ 297us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:56.954990 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:56.956327 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:56.958258 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.958258 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.958259 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.958440 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.958677 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.958678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.958678 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.958740 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.958973 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:56.958973 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:56.959014 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 06:42:56.959080 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 06:42:56.959167 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 06:42:56.959281 13667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.952287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44552 (local address 127.27.41.189:41705)
0810 06:42:56.952329 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.952331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.952341 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:42:56.952367 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.952368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.952377 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.952443 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.952661 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.953383 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.954361 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.954542 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.954596 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.956498 (+ 1902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.956499 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.956499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.956505 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.958169 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.958533 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.958534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.958534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.958591 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.958801 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.958802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.958802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.958905 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.958986 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.959112 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.959179 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:42:56.959908 13764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.188@KRBTEST.COM for kudu/127.27.41.188@KRBTEST.COM
I20260810 06:42:56.964414 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.957012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44538 (local address 127.27.41.190:34957)
0810 06:42:56.957046 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.957047 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.957092 (+ 45us) server_negotiation.cc:407] Connection header received
0810 06:42:56.957172 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.957173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.957180 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.957219 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.957909 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.958312 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.959026 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.959232 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.959316 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.961709 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.961710 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.961710 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.961717 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.963221 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.963552 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.963553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.963553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.963627 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.963864 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.963865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.963865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.964009 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.964196 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.964244 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.964318 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 06:42:56.967371 13766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.960142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:42633 (local address 127.0.0.1:60254)
0810 06:42:56.960219 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.960228 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:56.960293 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:56.960411 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:56.960412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:56.960554 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:56.960577 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.960578 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.961494 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.961495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.962171 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.962174 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.962705 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.962706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.962772 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.963197 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:56.963202 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:56.964451 (+ 1249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:56.966279 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.966280 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.966281 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.966474 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.966686 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.966686 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.966687 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.966748 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.967029 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:56.967029 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:56.967069 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 06:42:56.967162 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 06:42:56.967260 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260810 06:42:56.967450 13769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.960186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60254 (local address 127.27.41.188:42633)
0810 06:42:56.960221 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.960223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.960282 (+ 59us) server_negotiation.cc:407] Connection header received
0810 06:42:56.960347 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.960348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.960357 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.960408 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.960649 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.961412 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.962233 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.962591 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.962673 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.964551 (+ 1878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.964552 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.964552 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.964558 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.966199 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.966547 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.966548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.966548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.966602 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.966825 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.966826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.966826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.966939 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.967037 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.967185 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.967312 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":18}
I20260810 06:42:56.968942 13764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1: Bootstrap starting.
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.189@KRBTEST.COM
I20260810 06:42:56.970101 13764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1: Neither blocks nor log segments found. Creating new log.
I20260810 06:42:56.970484 13764 log.cc:824] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1: Log is configured to *not* fsync() on all Append() calls
I20260810 06:42:56.971349 13764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1: No bootstrap required, opened a new log
I20260810 06:42:56.972847 13667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.965407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44554 (local address 127.27.41.189:41705)
0810 06:42:56.965451 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.965454 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.965461 (+ 7us) server_negotiation.cc:407] Connection header received
0810 06:42:56.965485 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.965486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.965494 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.965562 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.966019 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.966585 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.967193 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.967385 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.967454 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.969629 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.969631 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.969631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.969638 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.971196 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.971592 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.971593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.971594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.971646 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.971852 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.971853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.971853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.971958 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.972701 (+ 743us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.972735 (+ 34us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.972793 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 06:42:56.972813 13764 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } }
I20260810 06:42:56.972991 13764 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:42:56.973104 13558 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } attempt: 2
I20260810 06:42:56.973042 13764 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ac7716b0fc407586c7a238138ab5a1, State: Initialized, Role: FOLLOWER
I20260810 06:42:56.973359 13764 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } }
I20260810 06:42:56.973670 13771 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } } }
I20260810 06:42:56.973737 13764 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:42:56.973771 13771 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:42:56.974207 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260810 06:42:56.975914 13789 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:42:56.975979 13789 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 10 06:42:56 dist-test-slave-bw88 krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for kudu/127.27.41.188@KRBTEST.COM
I20260810 06:42:56.976091 13671 master_runner.cc:186] Error getting master registration for 127.27.41.190:34957: OK, instance_id { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" instance_seqno: 1786344176628145 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 06:42:56.979360 13671 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:42:56.981734 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.973368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:42633 (local address 127.0.0.1:60260)
0810 06:42:56.973412 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:56.973424 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:56.973462 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:56.973746 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:56.973747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:56.973913 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:56.973966 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.973968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.974993 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.974994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.975758 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:56.975760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.976189 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.976190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:56.976250 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.976766 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:56.976772 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:56.978418 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:56.980351 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.980352 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.980352 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.980597 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.980806 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:56.980807 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:56.980807 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:56.980887 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:56.981292 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:56.981293 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:56.981404 (+ 111us) client_negotiation.cc:769] Sending connection context
0810 06:42:56.981487 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 06:42:56.981602 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260810 06:42:56.982136 13769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.973493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60260 (local address 127.27.41.188:42633)
0810 06:42:56.973578 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.973580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.973589 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:42:56.973629 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.973630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.973639 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.974098 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.974127 (+ 29us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.974895 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.975844 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.976103 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.976169 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.978543 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.978545 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.978545 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.978552 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.980165 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.980680 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.980681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.980681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.980736 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.980978 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.980979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.980979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.981172 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.981256 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.981964 (+ 708us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.982047 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 06:42:56.984715 13558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868: Bootstrap starting.
I20260810 06:42:56.986215 13558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868: Neither blocks nor log segments found. Creating new log.
I20260810 06:42:56.986613 13558 log.cc:824] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868: Log is configured to *not* fsync() on all Append() calls
I20260810 06:42:56.986800 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.976359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44542 (local address 127.27.41.190:34957)
0810 06:42:56.976393 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.976394 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.977493 (+ 1099us) server_negotiation.cc:407] Connection header received
0810 06:42:56.977605 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.977606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.977617 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.977655 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.978453 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.979108 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.980099 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.980373 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.980427 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.983494 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.983495 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.983496 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.983504 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.985310 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.985808 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.985810 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.985810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.985875 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.986127 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.986128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.986128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.986271 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.986353 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.986626 (+ 273us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.986707 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 06:42:56.988075 13667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.976674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44562 (local address 127.27.41.189:41705)
0810 06:42:56.976716 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.976717 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.979545 (+ 2828us) server_negotiation.cc:407] Connection header received
0810 06:42:56.980259 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.980260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.980270 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.980314 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.981572 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.982208 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.983309 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.983604 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.983645 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.985100 (+ 1455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.985101 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.985101 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.985109 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.986798 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.987239 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.987240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.987241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.987297 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.987508 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.987509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.987509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.987629 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.987708 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.987915 (+ 207us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.987990 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 06:42:56.989091 13558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868: No bootstrap required, opened a new log
I20260810 06:42:56.991117 13558 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } }
I20260810 06:42:56.991268 13558 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:42:56.991315 13558 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c026d158ddf47efa921ce4b764f0868, State: Initialized, Role: FOLLOWER
I20260810 06:42:56.991341 13793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:56.975562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60274 (local address 127.27.41.188:42633)
0810 06:42:56.975717 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:56.975719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:56.976799 (+ 1080us) server_negotiation.cc:407] Connection header received
0810 06:42:56.976864 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:56.976864 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:56.976873 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:56.976942 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:56.977782 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.978641 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.980307 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:56.980627 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:56.980672 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:56.987917 (+ 7245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:56.987919 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:56.987919 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:56.987927 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:56.990031 (+ 2104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.990443 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.990444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.990444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.990511 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:56.990745 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:56.990746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:56.990746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:56.990874 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:56.990968 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:56.991136 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 06:42:56.991216 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":78,"threads_started":1}
I20260810 06:42:56.991447 13558 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } }
I20260810 06:42:56.991767 13803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } } }
I20260810 06:42:56.991876 13558 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:42:56.991882 13803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 06:42:56.993986 13820 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:42:56.994053 13820 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:42:56.994694 13467 master_runner.cc:186] Error getting master registration for 127.27.41.189:41705: OK, instance_id { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" instance_seqno: 1786344176787148 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 06:42:56.997008 13467 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:42:57.024222 13660 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } attempt: 3
Aug 10 06:42:57 dist-test-slave-bw88 krb5kdc[13444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344176, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.189@KRBTEST.COM for kudu/127.27.41.188@KRBTEST.COM
I20260810 06:42:57.031778 13793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:57.024614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60286 (local address 127.27.41.188:42633)
0810 06:42:57.024655 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:57.024657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:57.024684 (+ 27us) server_negotiation.cc:407] Connection header received
0810 06:42:57.024780 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:57.024781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:57.024795 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:57.024865 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:57.025175 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:57.025879 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:57.026600 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:57.026890 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:57.026978 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:57.028795 (+ 1817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:57.028796 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:57.028796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:57.028804 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:57.030598 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:57.030979 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:57.030980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:57.030981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:57.031037 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:57.031244 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:57.031245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:57.031245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:57.031366 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:57.031436 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:57.031621 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 06:42:57.031696 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:42:57.031778 13664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:57.024577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:42633 (local address 127.0.0.1:60286)
0810 06:42:57.024633 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 06:42:57.024646 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:42:57.024700 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:42:57.024870 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:42:57.024871 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:42:57.025048 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:42:57.025095 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:57.025097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:57.025976 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:57.025977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:57.026472 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:42:57.026474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:42:57.026974 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:42:57.026975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:42:57.027049 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:57.027512 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:42:57.027519 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:42:57.028707 (+ 1188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:42:57.030683 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:57.030684 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:57.030684 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:57.030895 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:57.031113 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:42:57.031114 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:42:57.031114 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:42:57.031173 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:42:57.031447 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:42:57.031449 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:42:57.031493 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 06:42:57.031570 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 06:42:57.031677 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 06:42:57.033476 13660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2: Bootstrap starting.
I20260810 06:42:57.034178 13660 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2: Neither blocks nor log segments found. Creating new log.
I20260810 06:42:57.034511 13660 log.cc:824] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2: Log is configured to *not* fsync() on all Append() calls
I20260810 06:42:57.035326 13660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2: No bootstrap required, opened a new log
I20260810 06:42:57.036772 13660 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } }
I20260810 06:42:57.036952 13660 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:42:57.036998 13660 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8540e0de92e44ba9158e891bc9eacc2, State: Initialized, Role: FOLLOWER
I20260810 06:42:57.037145 13660 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } }
I20260810 06:42:57.037442 13826 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } } }
I20260810 06:42:57.037518 13660 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:42:57.037588 13826 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 06:42:57.039446 13843 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:42:57.039499 13843 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:42:57.041535 13568 master_runner.cc:263] No leader master found from master f8540e0de92e44ba9158e891bc9eacc2
I20260810 06:42:57.041581 13568 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 06:42:57.125856 13495 tablet.cc:2369] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:42:57.165831 13803 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:42:57.165954 13803 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } }
I20260810 06:42:57.166173 13803 leader_election.cc:288] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8540e0de92e44ba9158e891bc9eacc2 (127.27.41.189:41705), c6ac7716b0fc407586c7a238138ab5a1 (127.27.41.188:42633)
I20260810 06:42:57.166683 13730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c026d158ddf47efa921ce4b764f0868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ac7716b0fc407586c7a238138ab5a1" is_pre_election: true
I20260810 06:42:57.166857 13730 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c026d158ddf47efa921ce4b764f0868 in term 0.
I20260810 06:42:57.167078 13488 leader_election.cc:302] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c026d158ddf47efa921ce4b764f0868, c6ac7716b0fc407586c7a238138ab5a1; no voters:
I20260810 06:42:57.167304 13803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:42:57.167353 13803 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:42:57.167374 13803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:42:57.168331 13803 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } }
I20260810 06:42:57.168442 13803 leader_election.cc:288] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [CANDIDATE]: Term 1 election: Requested vote from peers f8540e0de92e44ba9158e891bc9eacc2 (127.27.41.189:41705), c6ac7716b0fc407586c7a238138ab5a1 (127.27.41.188:42633)
I20260810 06:42:57.168702 13730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c026d158ddf47efa921ce4b764f0868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ac7716b0fc407586c7a238138ab5a1"
I20260810 06:42:57.168773 13730 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:42:57.169658 13730 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c026d158ddf47efa921ce4b764f0868 in term 1.
I20260810 06:42:57.169843 13488 leader_election.cc:302] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c026d158ddf47efa921ce4b764f0868, c6ac7716b0fc407586c7a238138ab5a1; no voters:
I20260810 06:42:57.170233 13625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c026d158ddf47efa921ce4b764f0868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8540e0de92e44ba9158e891bc9eacc2" is_pre_election: true
I20260810 06:42:57.170383 13625 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c026d158ddf47efa921ce4b764f0868 in term 0.
I20260810 06:42:57.170488 13624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c026d158ddf47efa921ce4b764f0868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8540e0de92e44ba9158e891bc9eacc2"
I20260810 06:42:57.170542 13624 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:42:57.171240 13624 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c026d158ddf47efa921ce4b764f0868 in term 1.
I20260810 06:42:57.171561 13803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:42:57.171690 13803 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [term 1 LEADER]: Becoming Leader. State: Replica: 0c026d158ddf47efa921ce4b764f0868, State: Running, Role: LEADER
I20260810 06:42:57.171767 13803 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } }
I20260810 06:42:57.172102 13803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c026d158ddf47efa921ce4b764f0868. Latest consensus state: current_term: 1 leader_uuid: "0c026d158ddf47efa921ce4b764f0868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } } }
I20260810 06:42:57.172163 13803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [sys.catalog]: This master's current role is: LEADER
I20260810 06:42:57.172921 13850 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:42:57.173142 13850 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:42:57.174945 13624 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [term 1 FOLLOWER]: Refusing update from remote peer 0c026d158ddf47efa921ce4b764f0868: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:42:57.174927 13730 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [term 1 FOLLOWER]: Refusing update from remote peer 0c026d158ddf47efa921ce4b764f0868: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:42:57.175307 13803 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:42:57.175515 13803 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:42:57.176739 13826 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c026d158ddf47efa921ce4b764f0868. Latest consensus state: current_term: 1 leader_uuid: "0c026d158ddf47efa921ce4b764f0868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } } }
I20260810 06:42:57.176855 13826 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:42:57.176925 13771 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c026d158ddf47efa921ce4b764f0868. Latest consensus state: current_term: 1 leader_uuid: "0c026d158ddf47efa921ce4b764f0868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } } }
I20260810 06:42:57.177032 13771 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:42:57.178076 13847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c026d158ddf47efa921ce4b764f0868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } } }
I20260810 06:42:57.178167 13847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [sys.catalog]: This master's current role is: LEADER
I20260810 06:42:57.178627 13771 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c026d158ddf47efa921ce4b764f0868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } } }
I20260810 06:42:57.178709 13771 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:42:57.178836 13803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c026d158ddf47efa921ce4b764f0868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } } }
I20260810 06:42:57.178911 13803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868 [sys.catalog]: This master's current role is: LEADER
I20260810 06:42:57.179286 13826 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c026d158ddf47efa921ce4b764f0868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c026d158ddf47efa921ce4b764f0868" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34957 } } peers { permanent_uuid: "f8540e0de92e44ba9158e891bc9eacc2" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41705 } } peers { permanent_uuid: "c6ac7716b0fc407586c7a238138ab5a1" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 42633 } } }
I20260810 06:42:57.179373 13826 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:42:57.179513 13852 mvcc.cc:205] Tried to move back new op lower bound from 7316865749706203136 to 7316865749696040960. Current Snapshot: MvccSnapshot[applied={T|T < 7316865749706203136 or (T in {7316865749706203136})}]
I20260810 06:42:57.179615 13855 mvcc.cc:205] Tried to move back new op lower bound from 7316865749706203136 to 7316865749696040960. Current Snapshot: MvccSnapshot[applied={T|T < 7316865749706203136 or (T in {7316865749706203136})}]
I20260810 06:42:57.179780 13850 catalog_manager.cc:1347] Generated new cluster ID: f16b7785ab9b4913867c3389f5161df1
I20260810 06:42:57.179836 13850 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:42:57.187645 13850 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:42:57.188256 13850 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:42:57.194289 13850 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c026d158ddf47efa921ce4b764f0868: Generated new TSK 0
I20260810 06:42:57.194466 13850 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:42:57.976471 13789 catalog_manager.cc:1259] Loaded cluster ID: f16b7785ab9b4913867c3389f5161df1
I20260810 06:42:57.976550 13789 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1: loading cluster ID for follower catalog manager: success
I20260810 06:42:57.977415 13789 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1: acquiring CA information for follower catalog manager: success
I20260810 06:42:57.977730 13789 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c6ac7716b0fc407586c7a238138ab5a1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:42:58.039939 13843 catalog_manager.cc:1259] Loaded cluster ID: f16b7785ab9b4913867c3389f5161df1
I20260810 06:42:58.040021 13843 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2: loading cluster ID for follower catalog manager: success
I20260810 06:42:58.040872 13843 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2: acquiring CA information for follower catalog manager: success
I20260810 06:42:58.041236 13843 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f8540e0de92e44ba9158e891bc9eacc2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:42:58.247821 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 13467
I20260810 06:42:58.260207 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 13568
I20260810 06:42:58.268810 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 13671
2026-08-10T06:42:58Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3114 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:42:58 dist-test-slave-bw88 krb5kdc[13875](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:42:58 dist-test-slave-bw88 krb5kdc[13875](info): set up 2 sockets
Aug 10 06:42:58 dist-test-slave-bw88 krb5kdc[13875](info): commencing operation
krb5kdc: starting...
W20260810 06:42:59.443965 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:42:59 dist-test-slave-bw88 krb5kdc[13875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:42:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:42:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:42:59.562103 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:33315
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:33353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:33315
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:42:59.640553 13894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:42:59.640749 13894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:42:59.640771 13894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:42:59.641940 13894 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:42:59.641980 13894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:42:59.641994 13894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:42:59.642007 13894 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:42:59.642019 13894 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:42:59.643527 13894 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:33353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:33315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:33315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:42:59.643714 13894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:42:59.643904 13894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:42:59.648896 13900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:42:59.648896 13905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:59.648996 13894 server_base.cc:1034] running on GCE node
W20260810 06:42:59.648990 13902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:42:59.649490 13894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:42:59.649777 13894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:42:59.650915 13894 hybrid_clock.cc:648] HybridClock initialized: now 1786344179650904 us; error 27 us; skew 500 ppm
Aug 10 06:42:59 dist-test-slave-bw88 krb5kdc[13875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344179, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:42:59.653475 13894 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:42:59.653934 13894 webserver.cc:460] Webserver started at http://127.27.41.190:36297/ using document root <none> and password file <none>
I20260810 06:42:59.654172 13894 fs_manager.cc:359] Metadata directory not provided
I20260810 06:42:59.654217 13894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:42:59.654362 13894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:42:59.655479 13894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "aa4b1586527b4476b4fd7b97ce8372d6"
format_stamp: "Formatted at 2026-08-10 06:42:59 on dist-test-slave-bw88"
server_key: "d5ccc6318384ec41f284def95b19430a"
server_key_iv: "a6b497deb83f450d17be4d3557fa7c15"
server_key_version: "encryptionkey@0"
I20260810 06:42:59.655838 13894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "aa4b1586527b4476b4fd7b97ce8372d6"
format_stamp: "Formatted at 2026-08-10 06:42:59 on dist-test-slave-bw88"
server_key: "d5ccc6318384ec41f284def95b19430a"
server_key_iv: "a6b497deb83f450d17be4d3557fa7c15"
server_key_version: "encryptionkey@0"
I20260810 06:42:59.657176 13894 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:42:59.657967 13913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:59.658165 13894 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:42:59.658263 13894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "aa4b1586527b4476b4fd7b97ce8372d6"
format_stamp: "Formatted at 2026-08-10 06:42:59 on dist-test-slave-bw88"
server_key: "d5ccc6318384ec41f284def95b19430a"
server_key_iv: "a6b497deb83f450d17be4d3557fa7c15"
server_key_version: "encryptionkey@0"
I20260810 06:42:59.658332 13894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:42:59.680351 13894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:42:59.682667 13894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:42:59.682775 13894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:42:59.686852 13894 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:33315
I20260810 06:42:59.686904 13988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:33315 every 8 connection(s)
I20260810 06:42:59.687265 13894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:42:59.688105 13989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:42:59.690454 13989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6: Bootstrap starting.
I20260810 06:42:59.691047 13989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6: Neither blocks nor log segments found. Creating new log.
I20260810 06:42:59.691331 13989 log.cc:824] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6: Log is configured to *not* fsync() on all Append() calls
I20260810 06:42:59.692022 13989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6: No bootstrap required, opened a new log
I20260810 06:42:59.693675 13989 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa4b1586527b4476b4fd7b97ce8372d6" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33315 } }
I20260810 06:42:59.693835 13989 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:42:59.693859 13989 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa4b1586527b4476b4fd7b97ce8372d6, State: Initialized, Role: FOLLOWER
I20260810 06:42:59.694024 13989 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa4b1586527b4476b4fd7b97ce8372d6" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33315 } }
I20260810 06:42:59.694115 13989 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:42:59.694160 13989 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:42:59.694209 13989 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:42:59.694705 13989 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa4b1586527b4476b4fd7b97ce8372d6" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33315 } }
I20260810 06:42:59.694816 13989 leader_election.cc:302] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa4b1586527b4476b4fd7b97ce8372d6; no voters:
I20260810 06:42:59.694999 13989 leader_election.cc:288] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:42:59.695063 13994 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:42:59.695254 13989 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:42:59.695261 13994 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [term 1 LEADER]: Becoming Leader. State: Replica: aa4b1586527b4476b4fd7b97ce8372d6, State: Running, Role: LEADER
I20260810 06:42:59.695385 13994 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa4b1586527b4476b4fd7b97ce8372d6" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33315 } }
I20260810 06:42:59.695962 13996 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa4b1586527b4476b4fd7b97ce8372d6. Latest consensus state: current_term: 1 leader_uuid: "aa4b1586527b4476b4fd7b97ce8372d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa4b1586527b4476b4fd7b97ce8372d6" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33315 } } }
I20260810 06:42:59.696055 13996 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [sys.catalog]: This master's current role is: LEADER
I20260810 06:42:59.696210 13995 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa4b1586527b4476b4fd7b97ce8372d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa4b1586527b4476b4fd7b97ce8372d6" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33315 } } }
I20260810 06:42:59.696305 13995 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6 [sys.catalog]: This master's current role is: LEADER
I20260810 06:42:59.696475 14007 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:42:59.696957 14007 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:42:59.696954 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 13894
I20260810 06:42:59.697094 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:42:59.697271 27814 external_mini_cluster.cc:1428] Setting key ffe6ec1ba9aec66bd8aef4d371336920
I20260810 06:42:59.698486 14007 catalog_manager.cc:1347] Generated new cluster ID: 1e4e2a6d8a3e484bba36540b50019b23
I20260810 06:42:59.698539 14007 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:42:59.703504 14007 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:42:59.704255 14007 catalog_manager.cc:1504] Loading token signing keys...
Aug 10 06:42:59 dist-test-slave-bw88 krb5kdc[13875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:42:59.708693 14007 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa4b1586527b4476b4fd7b97ce8372d6: Generated new TSK 0
I20260810 06:42:59.708874 14007 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:42:59.709132 14018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:42:59.697931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45866 (local address 127.27.41.190:33315)
0810 06:42:59.698243 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0810 06:42:59.698251 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:42:59.698282 (+ 31us) server_negotiation.cc:407] Connection header received
0810 06:42:59.698388 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:42:59.698394 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:42:59.698441 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:42:59.698576 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:42:59.699380 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:59.700721 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:59.701764 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:42:59.702406 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:42:59.702534 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:42:59.705435 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:42:59.705439 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:42:59.705439 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:42:59.705451 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:42:59.707394 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:59.707826 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:59.707828 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:59.707829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:59.707931 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:42:59.708153 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:42:59.708154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:42:59.708155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:42:59.708437 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:42:59.708613 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0810 06:42:59.708720 (+ 107us) server_negotiation.cc:299] Negotiation successful
0810 06:42:59.708905 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":84,"threads_started":1}
I20260810 06:42:59.710088 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:42:59.712950 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 13894
2026-08-10T06:42:59Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1443 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:42:59 dist-test-slave-bw88 krb5kdc[14027](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:42:59 dist-test-slave-bw88 krb5kdc[14027](info): set up 2 sockets
Aug 10 06:42:59 dist-test-slave-bw88 krb5kdc[14027](info): commencing operation
krb5kdc: starting...
W20260810 06:43:00.912487 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:43:00 dist-test-slave-bw88 krb5kdc[14027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:43:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:43:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:43:01.035558 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:46465
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:46465
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:43:01.121794 14049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:01.122036 14049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:01.122077 14049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:01.123219 14049 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:43:01.123284 14049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:01.123309 14049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:01.123328 14049 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:43:01.123363 14049 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:43:01.124861 14049 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:46465
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:46465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:01.125151 14049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:01.125440 14049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:01.130438 14059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:01.130585 14049 server_base.cc:1034] running on GCE node
W20260810 06:43:01.130522 14056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:01.130507 14061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:01.130964 14049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:01.131273 14049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:01.132442 14049 hybrid_clock.cc:648] HybridClock initialized: now 1786344181132421 us; error 39 us; skew 500 ppm
Aug 10 06:43:01 dist-test-slave-bw88 krb5kdc[14027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344181, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:01.135087 14049 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:43:01.135586 14049 webserver.cc:460] Webserver started at http://127.27.41.190:44783/ using document root <none> and password file <none>
I20260810 06:43:01.135823 14049 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:01.135892 14049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:01.136049 14049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:43:01.137079 14049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "e5e0075da75a4c8785637e44ca351f44"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "f9680df689c945cbf20e43c00f18f78f"
server_key_iv: "dcbf4523692e17283864df663ddf2f4e"
server_key_version: "encryptionkey@0"
I20260810 06:43:01.137509 14049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "e5e0075da75a4c8785637e44ca351f44"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "f9680df689c945cbf20e43c00f18f78f"
server_key_iv: "dcbf4523692e17283864df663ddf2f4e"
server_key_version: "encryptionkey@0"
I20260810 06:43:01.138875 14049 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:43:01.139678 14073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:01.139854 14049 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:43:01.139961 14049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "e5e0075da75a4c8785637e44ca351f44"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "f9680df689c945cbf20e43c00f18f78f"
server_key_iv: "dcbf4523692e17283864df663ddf2f4e"
server_key_version: "encryptionkey@0"
I20260810 06:43:01.140061 14049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:01.148526 14049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:01.150604 14049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:01.150758 14049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:01.154930 14049 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:46465
I20260810 06:43:01.154984 14137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:46465 every 8 connection(s)
I20260810 06:43:01.155337 14049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:43:01.156301 14138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:01.158639 14138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Bootstrap starting.
I20260810 06:43:01.159221 14138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:01.159513 14138 log.cc:824] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:01.160266 14138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: No bootstrap required, opened a new log
I20260810 06:43:01.160552 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 14049
I20260810 06:43:01.160678 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:43:01.160869 27814 external_mini_cluster.cc:1428] Setting key d34227dca3e36fe1d82469ea2532dda5
I20260810 06:43:01.162638 14138 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } }
I20260810 06:43:01.162824 14138 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:01.162866 14138 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e0075da75a4c8785637e44ca351f44, State: Initialized, Role: FOLLOWER
I20260810 06:43:01.163015 14138 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } }
I20260810 06:43:01.163108 14138 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:43:01.163159 14138 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:43:01.163210 14138 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:01.163763 14138 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } }
I20260810 06:43:01.163888 14138 leader_election.cc:302] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5e0075da75a4c8785637e44ca351f44; no voters:
I20260810 06:43:01.164104 14138 leader_election.cc:288] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:43:01.164126 14144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:43:01.164247 14144 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 1 LEADER]: Becoming Leader. State: Replica: e5e0075da75a4c8785637e44ca351f44, State: Running, Role: LEADER
I20260810 06:43:01.164404 14138 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:43:01.164388 14144 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } }
I20260810 06:43:01.164860 14145 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5e0075da75a4c8785637e44ca351f44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } } }
I20260810 06:43:01.165113 14145 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: This master's current role is: LEADER
I20260810 06:43:01.165030 14146 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5e0075da75a4c8785637e44ca351f44. Latest consensus state: current_term: 1 leader_uuid: "e5e0075da75a4c8785637e44ca351f44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } } }
I20260810 06:43:01.165630 14146 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: This master's current role is: LEADER
I20260810 06:43:01.165644 14157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:43:01.166647 14157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:43:01.168356 14157 catalog_manager.cc:1347] Generated new cluster ID: f8d8a4cfb47349c29136bbad0edcaf61
I20260810 06:43:01.168411 14157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:43:01 dist-test-slave-bw88 krb5kdc[14027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:01.173125 14143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.161433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46902 (local address 127.27.41.190:46465)
0810 06:43:01.161636 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:01.161644 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:01.161673 (+ 29us) server_negotiation.cc:407] Connection header received
0810 06:43:01.162149 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:01.162155 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:01.162200 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:01.162312 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:01.163164 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.164621 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.165750 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.166390 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.166503 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.169758 (+ 3255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:01.169762 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:01.169762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:01.169774 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:01.171575 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:01.171949 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:01.171952 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:01.171952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:01.172056 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:01.172308 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:01.172309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:01.172310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:01.172531 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:01.172712 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:01.172791 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 06:43:01.172927 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":105,"threads_started":1}
I20260810 06:43:01.173884 14157 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:43:01.174595 14157 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:43:01.178134 14157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Generated new TSK 0
I20260810 06:43:01.178323 14157 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:43:01.212270 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:46465
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:43:01.303692 14176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:01.303887 14176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:01.303910 14176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:01.305094 14176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:01.305137 14176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:01.305163 14176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:43:01.306666 14176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:46465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:01.306907 14176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:01.307166 14176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:01.313009 14183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:01.313161 14176 server_base.cc:1034] running on GCE node
W20260810 06:43:01.313113 14186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:01.313025 14184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:01.313529 14176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:01.313807 14176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:01.314999 14176 hybrid_clock.cc:648] HybridClock initialized: now 1786344181314976 us; error 38 us; skew 500 ppm
Aug 10 06:43:01 dist-test-slave-bw88 krb5kdc[14027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344181, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:01.317726 14176 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:43:01.318171 14176 webserver.cc:460] Webserver started at http://127.27.41.129:43411/ using document root <none> and password file <none>
I20260810 06:43:01.318361 14176 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:01.318403 14176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:01.318499 14176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:43:01.319473 14176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "ff35ea807d7445e3bf4d683b695d49a3"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "93c94a594ddc93fee828f2bf7780ac6b"
server_key_iv: "e179dcaa70788f1c20b6ebe9e8652ed9"
server_key_version: "encryptionkey@0"
I20260810 06:43:01.319784 14176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "ff35ea807d7445e3bf4d683b695d49a3"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "93c94a594ddc93fee828f2bf7780ac6b"
server_key_iv: "e179dcaa70788f1c20b6ebe9e8652ed9"
server_key_version: "encryptionkey@0"
I20260810 06:43:01.321046 14176 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:43:01.321828 14196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:01.322036 14176 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:01.322146 14176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "ff35ea807d7445e3bf4d683b695d49a3"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "93c94a594ddc93fee828f2bf7780ac6b"
server_key_iv: "e179dcaa70788f1c20b6ebe9e8652ed9"
server_key_version: "encryptionkey@0"
I20260810 06:43:01.322223 14176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:01.331272 14176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:01.333577 14176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:01.333731 14176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:01.333954 14176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:01.334280 14176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:43:01.334334 14176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:01.334370 14176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:43:01.334398 14176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:01.340472 14176 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:43621
I20260810 06:43:01.340523 14366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:43621 every 8 connection(s)
I20260810 06:43:01.340850 14176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
Aug 10 06:43:01 dist-test-slave-bw88 krb5kdc[14027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344181, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:01.347692 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 14176
I20260810 06:43:01.347812 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:43:01.348043 27814 external_mini_cluster.cc:1428] Setting key b9e3607367f6b9d4c202d8955daa8641
I20260810 06:43:01.350370 14143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.341640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:47785 (local address 127.27.41.190:46465)
0810 06:43:01.341710 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:01.341712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:01.341880 (+ 168us) server_negotiation.cc:407] Connection header received
0810 06:43:01.342348 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:01.342349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:01.342358 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:01.342427 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:01.343352 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.343955 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.344910 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.345104 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.345156 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.347348 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:01.347349 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:01.347350 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:01.347355 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:01.348865 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:01.349390 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:01.349391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:01.349391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:01.349456 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:01.349748 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:01.349749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:01.349749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:01.349850 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:01.349902 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:01.350224 (+ 322us) server_negotiation.cc:299] Negotiation successful
0810 06:43:01.350295 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 06:43:01.350682 14370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.341602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:47785)
0810 06:43:01.341752 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:01.341792 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:01.342269 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:01.342478 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:01.342481 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:01.343093 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:01.343279 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.343284 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.344056 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.344056 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.344837 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.344838 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.345179 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.345180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.345292 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.345831 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:01.345839 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:01.347267 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:01.348949 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:01.348957 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:01.348960 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:01.349259 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:01.349524 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:01.349525 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:01.349526 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:01.349677 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:01.349916 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:01.349923 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:01.350090 (+ 167us) client_negotiation.cc:769] Sending connection context
0810 06:43:01.350201 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 06:43:01.350386 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260810 06:43:01.351382 14367 heartbeater.cc:347] Connected to a master server at 127.27.41.190:46465
I20260810 06:43:01.351493 14367 heartbeater.cc:464] Registering TS with master...
I20260810 06:43:01.351667 14367 heartbeater.cc:511] Master 127.27.41.190:46465 requested a full tablet report, sending...
I20260810 06:43:01.352236 14092 ts_manager.cc:194] Registered new tserver with Master: ff35ea807d7445e3bf4d683b695d49a3 (127.27.41.129:43621)
I20260810 06:43:01.352881 14092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:47785
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:43:01.374269 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:46465
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:43:01.456399 14373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:01.456621 14373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:01.456660 14373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:01.457767 14373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:01.457834 14373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:01.457876 14373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:43:01.459311 14373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:46465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:01.459566 14373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:01.459800 14373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:01.464883 14382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:01.464897 14380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:01.465051 14373 server_base.cc:1034] running on GCE node
W20260810 06:43:01.464982 14378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:01.465396 14373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:01.465691 14373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:01.466868 14373 hybrid_clock.cc:648] HybridClock initialized: now 1786344181466854 us; error 44 us; skew 500 ppm
Aug 10 06:43:01 dist-test-slave-bw88 krb5kdc[14027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344181, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:01.469427 14373 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:43:01.469866 14373 webserver.cc:460] Webserver started at http://127.27.41.130:33705/ using document root <none> and password file <none>
I20260810 06:43:01.470067 14373 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:01.470106 14373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:01.470193 14373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:43:01.471140 14373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "9f60721dd90b4be3948c10da2ef9c292"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "7a81d84dd495dbbba8223f32fed80598"
server_key_iv: "8e2a221a005c959dc3da16db5c3320fd"
server_key_version: "encryptionkey@0"
I20260810 06:43:01.471444 14373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "9f60721dd90b4be3948c10da2ef9c292"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "7a81d84dd495dbbba8223f32fed80598"
server_key_iv: "8e2a221a005c959dc3da16db5c3320fd"
server_key_version: "encryptionkey@0"
I20260810 06:43:01.472640 14373 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:43:01.473433 14391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:01.473640 14373 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:01.473729 14373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "9f60721dd90b4be3948c10da2ef9c292"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "7a81d84dd495dbbba8223f32fed80598"
server_key_iv: "8e2a221a005c959dc3da16db5c3320fd"
server_key_version: "encryptionkey@0"
I20260810 06:43:01.473781 14373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:01.497465 14373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:01.499704 14373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:01.499825 14373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:01.500025 14373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:01.500360 14373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:43:01.500396 14373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:01.500418 14373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:43:01.500465 14373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:01.506572 14373 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:43767
I20260810 06:43:01.506711 14553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:43767 every 8 connection(s)
I20260810 06:43:01.507004 14373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:43:01.509199 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 14373
I20260810 06:43:01.509296 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:43:01.509501 27814 external_mini_cluster.cc:1428] Setting key 50abf267febff19182081518d4f22fb2
Aug 10 06:43:01 dist-test-slave-bw88 krb5kdc[14027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344181, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:01.517416 14143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.507774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:39499 (local address 127.27.41.190:46465)
0810 06:43:01.507845 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:01.507847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:01.508060 (+ 213us) server_negotiation.cc:407] Connection header received
0810 06:43:01.508563 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:01.508564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:01.508608 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:01.508687 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:01.509874 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.510580 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.511575 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.511880 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.511953 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.514210 (+ 2257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:01.514212 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:01.514212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:01.514220 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:01.515937 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:01.516379 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:01.516381 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:01.516381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:01.516449 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:01.516700 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:01.516701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:01.516702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:01.516852 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:01.516933 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:01.517168 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 06:43:01.517264 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 06:43:01.517488 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.507742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:39499)
0810 06:43:01.507916 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:01.507959 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:01.508477 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:01.508759 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:01.508763 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:01.509482 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:01.509787 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.509795 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.510677 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.510677 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.511487 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.511490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.511965 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.511966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.512127 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.512648 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:01.512657 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:01.514110 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:01.516037 (+ 1927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:01.516044 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:01.516045 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:01.516282 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:01.516527 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:01.516527 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:01.516528 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:01.516629 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:01.516924 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:01.516928 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:01.517037 (+ 109us) client_negotiation.cc:769] Sending connection context
0810 06:43:01.517116 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 06:43:01.517230 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
I20260810 06:43:01.517997 14554 heartbeater.cc:347] Connected to a master server at 127.27.41.190:46465
I20260810 06:43:01.518085 14554 heartbeater.cc:464] Registering TS with master...
I20260810 06:43:01.518271 14554 heartbeater.cc:511] Master 127.27.41.190:46465 requested a full tablet report, sending...
I20260810 06:43:01.518714 14092 ts_manager.cc:194] Registered new tserver with Master: 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767)
I20260810 06:43:01.519234 14092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:39499
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:43:01.536684 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:46465
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:43:01.619712 14562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:01.619908 14562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:01.619931 14562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:01.621097 14562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:01.621155 14562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:01.621201 14562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:43:01.622684 14562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:46465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:01.622944 14562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:01.623189 14562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:01.628543 14568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:01.628563 14571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:01.628598 14562 server_base.cc:1034] running on GCE node
W20260810 06:43:01.628571 14569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:01.629036 14562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:01.629290 14562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:01.630473 14562 hybrid_clock.cc:648] HybridClock initialized: now 1786344181630460 us; error 31 us; skew 500 ppm
Aug 10 06:43:01 dist-test-slave-bw88 krb5kdc[14027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344181, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:01.632925 14562 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:43:01.633505 14562 webserver.cc:460] Webserver started at http://127.27.41.131:42179/ using document root <none> and password file <none>
I20260810 06:43:01.633770 14562 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:01.633841 14562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:01.633988 14562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:43:01.635089 14562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "dc888a5ea15f4fad81302482c9cc9d7a"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "39ef30a9696cab0ee9730d910c1f4924"
server_key_iv: "d55b8f21b02e6dae9a468f37113b6c12"
server_key_version: "encryptionkey@0"
I20260810 06:43:01.635478 14562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "dc888a5ea15f4fad81302482c9cc9d7a"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "39ef30a9696cab0ee9730d910c1f4924"
server_key_iv: "d55b8f21b02e6dae9a468f37113b6c12"
server_key_version: "encryptionkey@0"
I20260810 06:43:01.637012 14562 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:43:01.637899 14578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:01.638093 14562 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:01.638187 14562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "dc888a5ea15f4fad81302482c9cc9d7a"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "39ef30a9696cab0ee9730d910c1f4924"
server_key_iv: "d55b8f21b02e6dae9a468f37113b6c12"
server_key_version: "encryptionkey@0"
I20260810 06:43:01.638286 14562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:01.655807 14562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:01.657780 14562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:01.657950 14562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:01.658226 14562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:01.658552 14562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:43:01.658610 14562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:01.658653 14562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:43:01.658682 14562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:01.665233 14562 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:34079
I20260810 06:43:01.665295 14739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:34079 every 8 connection(s)
I20260810 06:43:01.665719 14562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
Aug 10 06:43:01 dist-test-slave-bw88 krb5kdc[14027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344181, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:01.672086 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 14562
I20260810 06:43:01.672207 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:43:01.672385 27814 external_mini_cluster.cc:1428] Setting key 13c51a8343468124c35927bb2635630e
I20260810 06:43:01.674799 14143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.666493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:60429 (local address 127.27.41.190:46465)
0810 06:43:01.666542 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:01.666545 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:01.666810 (+ 265us) server_negotiation.cc:407] Connection header received
0810 06:43:01.667321 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:01.667323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:01.667334 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:01.667388 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:01.668273 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.668748 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.669798 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.669978 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.670031 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.671960 (+ 1929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:01.671962 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:01.671962 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:01.671969 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:01.673614 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:01.673995 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:01.673996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:01.673996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:01.674084 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:01.674289 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:01.674290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:01.674290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:01.674394 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:01.674444 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:01.674672 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 06:43:01.674739 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:43:01.674932 14744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.666484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:60429)
0810 06:43:01.666688 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:01.666724 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:01.667234 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:01.667440 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:01.667443 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:01.667997 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:01.668200 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.668205 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.668829 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.668829 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.669726 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.669729 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.670050 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.670051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.670148 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.670551 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:01.670559 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:01.671858 (+ 1299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:01.673677 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:01.673683 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:01.673685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:01.673907 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:01.674149 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:01.674150 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:01.674150 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:01.674233 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:01.674439 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:01.674441 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:01.674540 (+ 99us) client_negotiation.cc:769] Sending connection context
0810 06:43:01.674638 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 06:43:01.674753 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":118,"threads_started":1}
I20260810 06:43:01.675400 14740 heartbeater.cc:347] Connected to a master server at 127.27.41.190:46465
I20260810 06:43:01.675480 14740 heartbeater.cc:464] Registering TS with master...
I20260810 06:43:01.675611 14740 heartbeater.cc:511] Master 127.27.41.190:46465 requested a full tablet report, sending...
I20260810 06:43:01.675942 14092 ts_manager.cc:194] Registered new tserver with Master: dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079)
I20260810 06:43:01.676316 14092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:60429
I20260810 06:43:01.684253 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:43:01.691534 14143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.685615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46916 (local address 127.27.41.190:46465)
0810 06:43:01.685694 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:01.685696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:01.685805 (+ 109us) server_negotiation.cc:407] Connection header received
0810 06:43:01.685883 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:01.685884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:01.685895 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:01.685966 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:01.686547 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.687004 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.687753 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.687937 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.688021 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.689116 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:01.689117 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:01.689118 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:01.689125 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:01.690330 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:01.690706 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:01.690707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:01.690707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:01.690765 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:01.690978 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:01.690979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:01.690980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:01.691125 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:01.691234 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:01.691356 (+ 122us) server_negotiation.cc:299] Negotiation successful
0810 06:43:01.691436 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 06:43:01.692909 14092 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46916:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:43:01.695019 14092 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:43:01.701469 14761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.697272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:43621 (local address 127.0.0.1:47460)
0810 06:43:01.697680 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:01.697691 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:01.697770 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:01.698054 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:01.698057 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:01.698060 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:01.698129 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.698131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.699096 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.699097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.700262 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.700265 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.701133 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.701134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.701247 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.701260 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 06:43:01.701332 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 06:43:01.701398 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"mutex_wait_us":49,"thread_start_us":123,"threads_started":1}
I20260810 06:43:01.701733 14757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.697272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:34079 (local address 127.0.0.1:56254)
0810 06:43:01.697641 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:01.697688 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:01.697769 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:01.698080 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:01.698081 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:01.698083 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:01.698200 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.698202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.699124 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.699125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.700450 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.700453 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.701475 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.701477 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.701566 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.701571 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:43:01.701631 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 06:43:01.701668 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":42,"thread_start_us":97,"threads_started":1}
I20260810 06:43:01.701792 14760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.697442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47460 (local address 127.27.41.129:43621)
0810 06:43:01.697852 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:01.697858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:01.697870 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:43:01.697914 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:01.697916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:01.697931 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:01.698211 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:01.698292 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.698982 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.700352 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.701041 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.701120 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.701207 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:01.701668 (+ 461us) server_negotiation.cc:299] Negotiation successful
0810 06:43:01.701715 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":78,"threads_started":1}
I20260810 06:43:01.702057 14759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.697404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56254 (local address 127.27.41.131:34079)
0810 06:43:01.697597 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:01.697602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:01.697856 (+ 254us) server_negotiation.cc:407] Connection header received
0810 06:43:01.697897 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:01.697900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:01.697917 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:01.698081 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:01.698314 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.699001 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.700539 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.701282 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.701375 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.701433 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:01.701915 (+ 482us) server_negotiation.cc:299] Negotiation successful
0810 06:43:01.701961 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":85,"threads_started":1}
I20260810 06:43:01.702536 14266 tablet_service.cc:1467] Processing CreateTablet for tablet 8a68cd028ff44b40872efc3ab48d6761 (DEFAULT_TABLE table=test-table [id=2f602d29bc21431b889e5441ad5f58ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:43:01.702684 14646 tablet_service.cc:1467] Processing CreateTablet for tablet 8a68cd028ff44b40872efc3ab48d6761 (DEFAULT_TABLE table=test-table [id=2f602d29bc21431b889e5441ad5f58ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:43:01.702939 14266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a68cd028ff44b40872efc3ab48d6761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:01.702965 14758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.697542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:43767 (local address 127.0.0.1:46346)
0810 06:43:01.699146 (+ 1604us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:01.699156 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:01.699211 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:01.699393 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:01.699394 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:01.699397 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:01.699434 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.699435 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.700671 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.700672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.701564 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.701567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.702641 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.702642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.702745 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.702750 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:43:01.702811 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 06:43:01.702884 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1582,"thread_start_us":79,"threads_started":1}
I20260810 06:43:01.703033 14646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a68cd028ff44b40872efc3ab48d6761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:01.703142 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.697802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46346 (local address 127.27.41.130:43767)
0810 06:43:01.697986 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:01.697991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:01.699230 (+ 1239us) server_negotiation.cc:407] Connection header received
0810 06:43:01.699279 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:01.699282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:01.699298 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:01.699385 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:01.699514 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.700566 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.701668 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.702534 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.702635 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.702692 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:01.702838 (+ 146us) server_negotiation.cc:299] Negotiation successful
0810 06:43:01.702929 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260810 06:43:01.703759 14461 tablet_service.cc:1467] Processing CreateTablet for tablet 8a68cd028ff44b40872efc3ab48d6761 (DEFAULT_TABLE table=test-table [id=2f602d29bc21431b889e5441ad5f58ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:43:01.704084 14461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a68cd028ff44b40872efc3ab48d6761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:01.706579 14764 tablet_bootstrap.cc:492] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a: Bootstrap starting.
I20260810 06:43:01.706858 14765 tablet_bootstrap.cc:492] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292: Bootstrap starting.
I20260810 06:43:01.707345 14764 tablet_bootstrap.cc:654] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:01.707535 14765 tablet_bootstrap.cc:654] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:01.708004 14764 log.cc:824] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:01.708123 14765 log.cc:824] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:01.708487 14766 tablet_bootstrap.cc:492] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Bootstrap starting.
I20260810 06:43:01.708833 14764 tablet_bootstrap.cc:492] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a: No bootstrap required, opened a new log
I20260810 06:43:01.708935 14764 ts_tablet_manager.cc:1397] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:43:01.709125 14766 tablet_bootstrap.cc:654] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:01.709776 14765 tablet_bootstrap.cc:492] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292: No bootstrap required, opened a new log
I20260810 06:43:01.709755 14766 log.cc:824] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:01.709846 14765 ts_tablet_manager.cc:1397] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:43:01.710608 14766 tablet_bootstrap.cc:492] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: No bootstrap required, opened a new log
I20260810 06:43:01.710681 14766 ts_tablet_manager.cc:1397] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:43:01.710831 14764 raft_consensus.cc:348] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } } peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } }
I20260810 06:43:01.710979 14764 raft_consensus.cc:374] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:01.711022 14764 raft_consensus.cc:729] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc888a5ea15f4fad81302482c9cc9d7a, State: Initialized, Role: FOLLOWER
I20260810 06:43:01.711171 14764 consensus_queue.cc:260] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } } peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } }
I20260810 06:43:01.711436 14764 ts_tablet_manager.cc:1428] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 06:43:01.711587 14740 heartbeater.cc:503] Master 127.27.41.190:46465 was elected leader, sending a full tablet report...
I20260810 06:43:01.711825 14765 raft_consensus.cc:348] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } } peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } }
I20260810 06:43:01.711982 14765 raft_consensus.cc:374] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:01.712025 14765 raft_consensus.cc:729] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f60721dd90b4be3948c10da2ef9c292, State: Initialized, Role: FOLLOWER
I20260810 06:43:01.712141 14765 consensus_queue.cc:260] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } } peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } }
I20260810 06:43:01.712414 14765 ts_tablet_manager.cc:1428] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:43:01.712559 14554 heartbeater.cc:503] Master 127.27.41.190:46465 was elected leader, sending a full tablet report...
I20260810 06:43:01.712661 14766 raft_consensus.cc:348] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } } peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } }
I20260810 06:43:01.712823 14766 raft_consensus.cc:374] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:01.712869 14766 raft_consensus.cc:729] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff35ea807d7445e3bf4d683b695d49a3, State: Initialized, Role: FOLLOWER
I20260810 06:43:01.712963 14766 consensus_queue.cc:260] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } } peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } }
I20260810 06:43:01.713263 14766 ts_tablet_manager.cc:1428] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:43:01.713323 14367 heartbeater.cc:503] Master 127.27.41.190:46465 was elected leader, sending a full tablet report...
W20260810 06:43:01.757757 14555 tablet.cc:2369] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:43:01.841732 14369 tablet.cc:2369] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:43:01.863796 14775 raft_consensus.cc:482] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:43:01.863955 14775 raft_consensus.cc:504] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } } peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } }
I20260810 06:43:01.864447 14775 leader_election.cc:288] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff35ea807d7445e3bf4d683b695d49a3 (127.27.41.129:43621), dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079)
I20260810 06:43:01.868201 14759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.864739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:37265 (local address 127.27.41.131:34079)
0810 06:43:01.864791 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:01.864793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:01.864947 (+ 154us) server_negotiation.cc:407] Connection header received
0810 06:43:01.865018 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:01.865019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:01.865027 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:01.865103 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:01.865288 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.866022 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.867322 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.867866 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.867937 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.867945 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:01.868098 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 06:43:01.868135 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 06:43:01.868201 14760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.864680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:48635 (local address 127.27.41.129:43621)
0810 06:43:01.864730 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:01.864733 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:01.864744 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:43:01.864846 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:01.864848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:01.864859 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:01.864913 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:01.865088 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.865898 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.867322 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.867861 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.867937 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.867945 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:01.868099 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 06:43:01.868134 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 06:43:01.868216 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.864631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:43621 (local address 127.27.41.130:48635)
0810 06:43:01.864691 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:01.864704 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:01.864748 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:01.864924 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:01.864926 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:01.864927 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:01.865009 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.865011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.865974 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.865975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.867231 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.867234 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.867944 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.867944 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.868025 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.868027 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:43:01.868079 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 06:43:01.868127 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":1}
I20260810 06:43:01.868235 14777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.864636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:34079 (local address 127.27.41.130:37265)
0810 06:43:01.864880 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:01.864891 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:01.864953 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:01.865121 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:01.865122 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:01.865123 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:01.865200 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.865202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.866094 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.866095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.867234 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:01.867237 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.867944 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.867945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:01.868021 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.868025 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:43:01.868089 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 06:43:01.868127 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":47,"thread_start_us":116,"threads_started":1}
I20260810 06:43:01.868610 14298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a68cd028ff44b40872efc3ab48d6761" candidate_uuid: "9f60721dd90b4be3948c10da2ef9c292" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff35ea807d7445e3bf4d683b695d49a3" is_pre_election: true
I20260810 06:43:01.868773 14298 raft_consensus.cc:2454] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f60721dd90b4be3948c10da2ef9c292 in term 0.
I20260810 06:43:01.868780 14675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a68cd028ff44b40872efc3ab48d6761" candidate_uuid: "9f60721dd90b4be3948c10da2ef9c292" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" is_pre_election: true
I20260810 06:43:01.868925 14675 raft_consensus.cc:2454] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f60721dd90b4be3948c10da2ef9c292 in term 0.
I20260810 06:43:01.869005 14392 leader_election.cc:302] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f60721dd90b4be3948c10da2ef9c292, ff35ea807d7445e3bf4d683b695d49a3; no voters:
I20260810 06:43:01.869138 14775 raft_consensus.cc:2781] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:43:01.869200 14775 raft_consensus.cc:482] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:43:01.869220 14775 raft_consensus.cc:3037] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:01.869956 14775 raft_consensus.cc:504] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } } peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } }
I20260810 06:43:01.870100 14775 leader_election.cc:288] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [CANDIDATE]: Term 1 election: Requested vote from peers ff35ea807d7445e3bf4d683b695d49a3 (127.27.41.129:43621), dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079)
I20260810 06:43:01.870290 14298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a68cd028ff44b40872efc3ab48d6761" candidate_uuid: "9f60721dd90b4be3948c10da2ef9c292" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff35ea807d7445e3bf4d683b695d49a3"
I20260810 06:43:01.870368 14675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a68cd028ff44b40872efc3ab48d6761" candidate_uuid: "9f60721dd90b4be3948c10da2ef9c292" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc888a5ea15f4fad81302482c9cc9d7a"
I20260810 06:43:01.870368 14298 raft_consensus.cc:3037] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:01.870425 14675 raft_consensus.cc:3037] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:01.871300 14675 raft_consensus.cc:2454] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f60721dd90b4be3948c10da2ef9c292 in term 1.
I20260810 06:43:01.871300 14298 raft_consensus.cc:2454] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f60721dd90b4be3948c10da2ef9c292 in term 1.
I20260810 06:43:01.871500 14392 leader_election.cc:302] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f60721dd90b4be3948c10da2ef9c292, ff35ea807d7445e3bf4d683b695d49a3; no voters:
I20260810 06:43:01.871610 14775 raft_consensus.cc:2781] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:43:01.871764 14775 raft_consensus.cc:686] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [term 1 LEADER]: Becoming Leader. State: Replica: 9f60721dd90b4be3948c10da2ef9c292, State: Running, Role: LEADER
I20260810 06:43:01.871865 14775 consensus_queue.cc:237] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } } peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } }
I20260810 06:43:01.872715 14092 catalog_manager.cc:5495] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130). New cstate: current_term: 1 leader_uuid: "9f60721dd90b4be3948c10da2ef9c292" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } health_report { overall_health: UNKNOWN } } }
I20260810 06:43:01.884498 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.882141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46358 (local address 127.27.41.130:43767)
0810 06:43:01.882183 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:01.882185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:01.882193 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:43:01.882263 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:01.882264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:01.882285 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:01.882358 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:43:01.882517 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.882946 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.883689 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:01.883870 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:01.883940 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:01.884151 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:43:01.884257 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:43:01.884354 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:01.884379 (+ 25us) server_negotiation.cc:299] Negotiation successful
0810 06:43:01.884399 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:43:01.886238 14675 raft_consensus.cc:1261] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a [term 1 FOLLOWER]: Refusing update from remote peer 9f60721dd90b4be3948c10da2ef9c292: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:43:01.886265 14298 raft_consensus.cc:1261] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Refusing update from remote peer 9f60721dd90b4be3948c10da2ef9c292: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:43:01.886626 14780 consensus_queue.cc:1035] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:43:01.886765 14775 consensus_queue.cc:1035] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:43:01.888896 14785 mvcc.cc:205] Tried to move back new op lower bound from 7316865769003577344 to 7316865768947781632. Current Snapshot: MvccSnapshot[applied={T|T < 7316865769003577344}]
I20260810 06:43:01.889533 14786 mvcc.cc:205] Tried to move back new op lower bound from 7316865769003577344 to 7316865768947781632. Current Snapshot: MvccSnapshot[applied={T|T < 7316865769003577344}]
I20260810 06:43:01.891204 14091 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:43:01.891294 14091 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:43:01.892030 14091 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Sending DeleteTablet for 3 replicas of tablet 8a68cd028ff44b40872efc3ab48d6761
I20260810 06:43:01.892406 14266 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a68cd028ff44b40872efc3ab48d6761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:01 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:47460
I20260810 06:43:01.892434 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 14176
I20260810 06:43:01.892436 14646 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a68cd028ff44b40872efc3ab48d6761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:01 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:56254
I20260810 06:43:01.892433 14461 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a68cd028ff44b40872efc3ab48d6761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:01 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:46346
I20260810 06:43:01.897854 14801 tablet_replica.cc:330] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292: stopping tablet replica
I20260810 06:43:01.897951 14801 raft_consensus.cc:2229] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:43:01.898037 14801 raft_consensus.cc:2258] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:43:01.898207 14800 tablet_replica.cc:330] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a: stopping tablet replica
I20260810 06:43:01.898298 14800 raft_consensus.cc:2229] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:43:01.898386 14800 raft_consensus.cc:2258] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:43:01.899230 14801 ts_tablet_manager.cc:1905] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:43:01.901338 14800 ts_tablet_manager.cc:1905] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:43:01.901799 14801 ts_tablet_manager.cc:1918] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:43:01.901948 14801 log.cc:1196] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/8a68cd028ff44b40872efc3ab48d6761
I20260810 06:43:01.902338 14801 ts_tablet_manager.cc:1939] T 8a68cd028ff44b40872efc3ab48d6761 P 9f60721dd90b4be3948c10da2ef9c292: Deleting consensus metadata
I20260810 06:43:01.902845 14074 catalog_manager.cc:4841] TS 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767): tablet 8a68cd028ff44b40872efc3ab48d6761 (table test-table [id=2f602d29bc21431b889e5441ad5f58ae]) successfully deleted
I20260810 06:43:01.903280 14800 ts_tablet_manager.cc:1918] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:43:01.903362 14800 log.cc:1196] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/8a68cd028ff44b40872efc3ab48d6761
I20260810 06:43:01.903664 14800 ts_tablet_manager.cc:1939] T 8a68cd028ff44b40872efc3ab48d6761 P dc888a5ea15f4fad81302482c9cc9d7a: Deleting consensus metadata
I20260810 06:43:01.904119 14075 catalog_manager.cc:4841] TS dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079): tablet 8a68cd028ff44b40872efc3ab48d6761 (table test-table [id=2f602d29bc21431b889e5441ad5f58ae]) successfully deleted
W20260810 06:43:01.906257 14074 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:43621 (error 108)
I20260810 06:43:01.906476 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 14373
I20260810 06:43:01.918197 14758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:01.918055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:43621 (local address 127.0.0.1:47476)
0810 06:43:01.918113 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:01.918157 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:43621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 06:43:01.918313 14074 catalog_manager.cc:4584] TS ff35ea807d7445e3bf4d683b695d49a3 (127.27.41.129:43621): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8a68cd028ff44b40872efc3ab48d6761: Network error: Client connection negotiation failed: client connection to 127.27.41.129:43621: connect: Connection refused (error 111)
I20260810 06:43:01.924710 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 14562
I20260810 06:43:01.940485 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 14049
I20260810 06:43:01.948347 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:46465
--webserver_interface=127.27.41.190
--webserver_port=44783
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:46465
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:43:02.031399 14803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:02.031607 14803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:02.031629 14803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:02.032668 14803 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:43:02.032702 14803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:02.032716 14803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:02.032728 14803 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:43:02.032740 14803 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:43:02.034250 14803 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:46465
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:46465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=44783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:02.034446 14803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:02.034628 14803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:02.044176 14809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:02.044196 14813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:02.044176 14810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:02.044199 14803 server_base.cc:1034] running on GCE node
I20260810 06:43:02.044620 14803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:02.044931 14803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:02.046070 14803 hybrid_clock.cc:648] HybridClock initialized: now 1786344182046060 us; error 29 us; skew 500 ppm
Aug 10 06:43:02 dist-test-slave-bw88 krb5kdc[14027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344182, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:02.048672 14803 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:43:02.049141 14803 webserver.cc:460] Webserver started at http://127.27.41.190:44783/ using document root <none> and password file <none>
I20260810 06:43:02.049434 14803 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:02.049520 14803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:02.050909 14803 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:02.051643 14822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:02.051813 14803 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:43:02.051900 14803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "e5e0075da75a4c8785637e44ca351f44"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "f9680df689c945cbf20e43c00f18f78f"
server_key_iv: "dcbf4523692e17283864df663ddf2f4e"
server_key_version: "encryptionkey@0"
I20260810 06:43:02.052270 14803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:02.108158 14803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:02.110720 14803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:02.110844 14803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:02.114938 14803 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:46465
I20260810 06:43:02.115026 14897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:46465 every 8 connection(s)
I20260810 06:43:02.115430 14803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:43:02.117290 14898 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:43:02.117972 14898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Bootstrap starting.
I20260810 06:43:02.124662 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 14803
I20260810 06:43:02.124994 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:43621
--local_ip_for_outbound_sockets=127.27.41.129
--tserver_master_addrs=127.27.41.190:46465
--webserver_port=43411
--webserver_interface=127.27.41.129
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:43:02.127311 14898 log.cc:824] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:02.129640 14898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:43:02.129978 14898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Bootstrap complete.
I20260810 06:43:02.132413 14898 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } }
I20260810 06:43:02.132696 14898 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e0075da75a4c8785637e44ca351f44, State: Initialized, Role: FOLLOWER
I20260810 06:43:02.132912 14898 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } }
I20260810 06:43:02.133016 14898 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:43:02.133078 14898 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:43:02.133127 14898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 1 FOLLOWER]: Advancing to term 2
I20260810 06:43:02.134264 14898 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } }
I20260810 06:43:02.134393 14898 leader_election.cc:302] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5e0075da75a4c8785637e44ca351f44; no voters:
I20260810 06:43:02.134627 14898 leader_election.cc:288] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 06:43:02.134667 14904 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 06:43:02.134783 14904 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 2 LEADER]: Becoming Leader. State: Replica: e5e0075da75a4c8785637e44ca351f44, State: Running, Role: LEADER
I20260810 06:43:02.134919 14898 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:43:02.134963 14904 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } }
I20260810 06:43:02.135362 14905 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e5e0075da75a4c8785637e44ca351f44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } } }
I20260810 06:43:02.135375 14907 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5e0075da75a4c8785637e44ca351f44. Latest consensus state: current_term: 2 leader_uuid: "e5e0075da75a4c8785637e44ca351f44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } } }
I20260810 06:43:02.135473 14905 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: This master's current role is: LEADER
I20260810 06:43:02.135502 14907 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: This master's current role is: LEADER
I20260810 06:43:02.135721 14913 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:43:02.136719 14913 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:43:02.136888 14913 catalog_manager.cc:1259] Loaded cluster ID: f8d8a4cfb47349c29136bbad0edcaf61
I20260810 06:43:02.137128 14913 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:43:02.137419 14913 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260810 06:43:02.142165 14913 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260810 06:43:02.144708 14913 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:43:02.144970 14913 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Loaded TSK: 0
I20260810 06:43:02.145212 14913 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 06:43:02.211777 14900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:02.212010 14900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:02.212049 14900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:02.213205 14900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:02.213269 14900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:02.213312 14900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:43:02.214803 14900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:43621
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=43411
--tserver_master_addrs=127.27.41.190:46465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:02.215054 14900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:02.215293 14900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:02.221436 14932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:02.221474 14933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:02.221475 14935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:02.221784 14900 server_base.cc:1034] running on GCE node
I20260810 06:43:02.222007 14900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:02.222283 14900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:02.223480 14900 hybrid_clock.cc:648] HybridClock initialized: now 1786344182223467 us; error 41 us; skew 500 ppm
Aug 10 06:43:02 dist-test-slave-bw88 krb5kdc[14027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344182, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:02.226531 14900 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:43:02.226992 14900 webserver.cc:460] Webserver started at http://127.27.41.129:43411/ using document root <none> and password file <none>
I20260810 06:43:02.227239 14900 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:02.227293 14900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:02.228652 14900 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:43:02.229393 14949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:02.229594 14900 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:43:02.229701 14900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "ff35ea807d7445e3bf4d683b695d49a3"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "93c94a594ddc93fee828f2bf7780ac6b"
server_key_iv: "e179dcaa70788f1c20b6ebe9e8652ed9"
server_key_version: "encryptionkey@0"
I20260810 06:43:02.230046 14900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:02.246922 14900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:02.249404 14900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:02.249567 14900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:02.249804 14900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:02.250298 14958 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 06:43:02.251711 14900 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 06:43:02.251763 14900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 06:43:02.251796 14900 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 06:43:02.252471 14900 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 06:43:02.252517 14900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 06:43:02.252562 14958 tablet_bootstrap.cc:492] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Bootstrap starting.
I20260810 06:43:02.260205 14900 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:43621
I20260810 06:43:02.260255 15106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:43621 every 8 connection(s)
I20260810 06:43:02.260653 14900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:43:02.261484 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 14900
I20260810 06:43:02.261803 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:43767
--local_ip_for_outbound_sockets=127.27.41.130
--tserver_master_addrs=127.27.41.190:46465
--webserver_port=33705
--webserver_interface=127.27.41.130
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:43:02.267753 14958 log.cc:824] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Log is configured to *not* fsync() on all Append() calls
Aug 10 06:43:02 dist-test-slave-bw88 krb5kdc[14027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344182, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:02.270973 14958 tablet_bootstrap.cc:492] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:43:02.271370 14958 tablet_bootstrap.cc:492] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Bootstrap complete.
I20260810 06:43:02.272688 15113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.261661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:47985 (local address 127.27.41.190:46465)
0810 06:43:02.261871 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:02.261881 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:02.262128 (+ 247us) server_negotiation.cc:407] Connection header received
0810 06:43:02.262753 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:02.262759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:02.262800 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:02.262937 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:02.263633 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.265073 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.266229 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.266641 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.266767 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.269207 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:02.269211 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:02.269211 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:02.269222 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:02.270926 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:02.271378 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:02.271382 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:02.271382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:02.271498 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:02.271775 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:02.271775 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:02.271776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:02.271994 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:02.272091 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:02.272384 (+ 293us) server_negotiation.cc:299] Negotiation successful
0810 06:43:02.272504 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":72,"threads_started":1}
I20260810 06:43:02.272703 15112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.261556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:47985)
0810 06:43:02.261985 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:02.262030 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:02.262523 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:02.262969 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:02.262972 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:02.263260 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:02.263451 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.263456 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.265198 (+ 1742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.265199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.266131 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.266134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.266767 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.266769 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.266908 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.267520 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:02.267528 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:02.269096 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:02.271033 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:02.271042 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:02.271044 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:02.271289 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:02.271587 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:02.271589 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:02.271589 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:02.271699 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:02.272077 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:02.272084 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:02.272221 (+ 137us) client_negotiation.cc:769] Sending connection context
0810 06:43:02.272327 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 06:43:02.272499 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":103,"threads_started":1}
I20260810 06:43:02.272845 14958 ts_tablet_manager.cc:1397] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.010s
I20260810 06:43:02.273442 15108 heartbeater.cc:347] Connected to a master server at 127.27.41.190:46465
I20260810 06:43:02.273531 15108 heartbeater.cc:464] Registering TS with master...
I20260810 06:43:02.273710 15108 heartbeater.cc:511] Master 127.27.41.190:46465 requested a full tablet report, sending...
I20260810 06:43:02.274446 14849 ts_manager.cc:194] Registered new tserver with Master: ff35ea807d7445e3bf4d683b695d49a3 (127.27.41.129:43621)
I20260810 06:43:02.274542 14958 raft_consensus.cc:348] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } } peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } }
I20260810 06:43:02.275050 14958 raft_consensus.cc:729] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff35ea807d7445e3bf4d683b695d49a3, State: Initialized, Role: FOLLOWER
I20260810 06:43:02.275291 14958 consensus_queue.cc:260] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } } peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } }
I20260810 06:43:02.275604 14958 ts_tablet_manager.cc:1428] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260810 06:43:02.275614 14849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:47985
I20260810 06:43:02.276691 15108 heartbeater.cc:503] Master 127.27.41.190:46465 was elected leader, sending a full tablet report...
Aug 10 06:43:02 dist-test-slave-bw88 krb5kdc[14027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344182, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for kudu/127.27.41.129@KRBTEST.COM
I20260810 06:43:02.283735 15117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.275284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47478 (local address 127.27.41.129:43621)
0810 06:43:02.276182 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:02.276186 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:02.276196 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:43:02.276227 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:02.276228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:02.276244 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:02.276324 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:02.276878 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.277751 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.278563 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.278861 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.278941 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.280829 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:02.280837 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:02.280837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:02.280844 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:02.282438 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:02.282862 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:02.282865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:02.282866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:02.282926 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:02.283145 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:02.283146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:02.283147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:02.283279 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:02.283367 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:02.283556 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 06:43:02.283641 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":869,"thread_start_us":67,"threads_started":1}
I20260810 06:43:02.283749 15116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.275031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:43621 (local address 127.0.0.1:47478)
0810 06:43:02.275938 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:02.275972 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:02.276033 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:02.276355 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:02.276361 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:02.276693 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:02.276751 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.276754 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.277835 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.277836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.278461 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.278463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.278941 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.278942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.279022 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.279506 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:02.279511 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:02.280739 (+ 1228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:02.282547 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:02.282555 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:02.282557 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:02.282765 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:02.283003 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:02.283004 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:02.283004 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:02.283075 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:02.283361 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:02.283368 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:02.283419 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 06:43:02.283518 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 06:43:02.283641 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":878,"thread_start_us":103,"threads_started":1}
I20260810 06:43:02.284448 15013 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a68cd028ff44b40872efc3ab48d6761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:01 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:47478
I20260810 06:43:02.285015 15119 tablet_replica.cc:330] stopping tablet replica
I20260810 06:43:02.285127 15119 raft_consensus.cc:2229] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:43:02.285195 15119 raft_consensus.cc:2258] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:43:02.285516 15119 ts_tablet_manager.cc:1905] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:43:02.287539 15119 ts_tablet_manager.cc:1918] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:43:02.287639 15119 log.cc:1196] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal/wals/8a68cd028ff44b40872efc3ab48d6761
I20260810 06:43:02.287875 15119 ts_tablet_manager.cc:1939] T 8a68cd028ff44b40872efc3ab48d6761 P ff35ea807d7445e3bf4d683b695d49a3: Deleting consensus metadata
I20260810 06:43:02.288379 14823 catalog_manager.cc:4841] TS ff35ea807d7445e3bf4d683b695d49a3 (127.27.41.129:43621): tablet 8a68cd028ff44b40872efc3ab48d6761 (table test-table [id=2f602d29bc21431b889e5441ad5f58ae]) successfully deleted
W20260810 06:43:02.354635 15114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:02.354818 15114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:02.354964 15114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:02.356784 15114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:02.356848 15114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:02.356896 15114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:43:02.359349 15114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:43767
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=33705
--tserver_master_addrs=127.27.41.190:46465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:02.359615 15114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:02.359877 15114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:02.366752 15130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:02.366772 15128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:02.366827 15127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:02.367055 15114 server_base.cc:1034] running on GCE node
I20260810 06:43:02.367301 15114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:02.367532 15114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:02.368710 15114 hybrid_clock.cc:648] HybridClock initialized: now 1786344182368689 us; error 32 us; skew 500 ppm
Aug 10 06:43:02 dist-test-slave-bw88 krb5kdc[14027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344182, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:02.371189 15114 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:43:02.371546 15114 webserver.cc:460] Webserver started at http://127.27.41.130:33705/ using document root <none> and password file <none>
I20260810 06:43:02.371748 15114 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:02.371803 15114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:02.373044 15114 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:43:02.373669 15140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:02.373865 15114 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:02.373960 15114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "9f60721dd90b4be3948c10da2ef9c292"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "7a81d84dd495dbbba8223f32fed80598"
server_key_iv: "8e2a221a005c959dc3da16db5c3320fd"
server_key_version: "encryptionkey@0"
I20260810 06:43:02.374281 15114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:02.385561 15114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:02.387422 15114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:02.387580 15114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:02.387797 15114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:02.388103 15114 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:43:02.388172 15114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:02.388212 15114 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:43:02.388239 15114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:02.394402 15114 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:43767
I20260810 06:43:02.394454 15304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:43767 every 8 connection(s)
I20260810 06:43:02.394780 15114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:43:02.399353 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 15114
I20260810 06:43:02.399617 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:34079
--local_ip_for_outbound_sockets=127.27.41.131
--tserver_master_addrs=127.27.41.190:46465
--webserver_port=42179
--webserver_interface=127.27.41.131
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:43:02 dist-test-slave-bw88 krb5kdc[14027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344182, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:02.405141 15113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.395508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:54573 (local address 127.27.41.190:46465)
0810 06:43:02.395573 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:02.395575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:02.395793 (+ 218us) server_negotiation.cc:407] Connection header received
0810 06:43:02.396342 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:02.396344 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:02.396357 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:02.396402 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:02.397371 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.397884 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.398961 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.399181 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.399272 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.402144 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:02.402146 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:02.402146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:02.402153 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:02.403511 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:02.404071 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:02.404072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:02.404072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:02.404130 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:02.404440 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:02.404441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:02.404442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:02.404581 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:02.404641 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:02.404998 (+ 357us) server_negotiation.cc:299] Negotiation successful
0810 06:43:02.405077 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 06:43:02.405496 15307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.395496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:54573)
0810 06:43:02.395682 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:02.395715 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:02.396228 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:02.396512 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:02.396515 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:02.397053 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:02.397233 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.397238 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.398004 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.398006 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.398838 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.398840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.399285 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.399286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.399421 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.399986 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:02.399994 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:02.402042 (+ 2048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:02.403631 (+ 1589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:02.403639 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:02.403641 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:02.403986 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:02.404202 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:02.404203 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:02.404203 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:02.404357 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:02.404660 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:02.404668 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:02.404848 (+ 180us) client_negotiation.cc:769] Sending connection context
0810 06:43:02.404978 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 06:43:02.405165 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":97,"threads_started":1}
I20260810 06:43:02.406064 15305 heartbeater.cc:347] Connected to a master server at 127.27.41.190:46465
I20260810 06:43:02.406158 15305 heartbeater.cc:464] Registering TS with master...
I20260810 06:43:02.406349 15305 heartbeater.cc:511] Master 127.27.41.190:46465 requested a full tablet report, sending...
I20260810 06:43:02.406739 14849 ts_manager.cc:194] Registered new tserver with Master: 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767)
I20260810 06:43:02.407114 14849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:54573
W20260810 06:43:02.484846 15308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:02.485077 15308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:02.485119 15308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:02.486380 15308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:02.486450 15308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:02.486495 15308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:43:02.487915 15308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:34079
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=42179
--tserver_master_addrs=127.27.41.190:46465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:02.488190 15308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:02.488428 15308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:43:02.493552 15308 server_base.cc:1034] running on GCE node
W20260810 06:43:02.493546 15318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:02.493613 15314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:02.493613 15315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:02.493968 15308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:02.494247 15308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:02.495411 15308 hybrid_clock.cc:648] HybridClock initialized: now 1786344182495397 us; error 27 us; skew 500 ppm
Aug 10 06:43:02 dist-test-slave-bw88 krb5kdc[14027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344182, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:02.497957 15308 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:43:02.498394 15308 webserver.cc:460] Webserver started at http://127.27.41.131:42179/ using document root <none> and password file <none>
I20260810 06:43:02.498651 15308 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:02.498736 15308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:02.500109 15308 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:02.500762 15329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:02.500960 15308 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 06:43:02.501075 15308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "dc888a5ea15f4fad81302482c9cc9d7a"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "39ef30a9696cab0ee9730d910c1f4924"
server_key_iv: "d55b8f21b02e6dae9a468f37113b6c12"
server_key_version: "encryptionkey@0"
I20260810 06:43:02.501523 15308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:02.513309 15308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:02.515273 15308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:02.515451 15308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:02.515683 15308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:02.515993 15308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:43:02.516048 15308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:02.516090 15308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:43:02.516117 15308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:02.522418 15308 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:34079
I20260810 06:43:02.522527 15486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:34079 every 8 connection(s)
I20260810 06:43:02.522833 15308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:43:02.526108 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 15308
Aug 10 06:43:02 dist-test-slave-bw88 krb5kdc[14027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344182, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:02.533102 15113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.523590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:51913 (local address 127.27.41.190:46465)
0810 06:43:02.523647 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:02.523650 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:02.523838 (+ 188us) server_negotiation.cc:407] Connection header received
0810 06:43:02.524345 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:02.524346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:02.524355 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:02.524416 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:02.525320 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.525916 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.527281 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.527603 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.527656 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.530101 (+ 2445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:02.530103 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:02.530103 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:02.530111 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:02.531506 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:02.531999 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:02.532001 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:02.532001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:02.532073 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:02.532365 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:02.532366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:02.532366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:02.532482 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:02.532541 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:02.532880 (+ 339us) server_negotiation.cc:299] Negotiation successful
0810 06:43:02.532970 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 06:43:02.533216 15489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.523541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:51913)
0810 06:43:02.523709 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:02.523751 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:02.524255 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:02.524471 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:02.524475 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:02.525039 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:02.525239 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.525244 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.526017 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.526019 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.527194 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.527197 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.527683 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.527684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.527824 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.528343 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:02.528351 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:02.529992 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:02.531590 (+ 1598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:02.531597 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:02.531599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:02.531909 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:02.532143 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:02.532144 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:02.532144 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:02.532288 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:02.532557 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:02.532564 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:02.532724 (+ 160us) client_negotiation.cc:769] Sending connection context
0810 06:43:02.532843 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 06:43:02.532959 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":93,"threads_started":1}
I20260810 06:43:02.533747 15487 heartbeater.cc:347] Connected to a master server at 127.27.41.190:46465
I20260810 06:43:02.533849 15487 heartbeater.cc:464] Registering TS with master...
I20260810 06:43:02.534057 15487 heartbeater.cc:511] Master 127.27.41.190:46465 requested a full tablet report, sending...
I20260810 06:43:02.534471 15491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.526550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33584 (local address 127.27.41.190:46465)
0810 06:43:02.526689 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:02.526691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:02.526764 (+ 73us) server_negotiation.cc:407] Connection header received
0810 06:43:02.526837 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:02.526837 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:02.526848 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:02.526910 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:02.527529 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.528152 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.528962 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.529272 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.529381 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.530983 (+ 1602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:02.530984 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:02.530985 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:02.530992 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:02.532670 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:02.533064 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:02.533066 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:02.533066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:02.533126 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:02.533781 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:02.533782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:02.533782 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:02.533928 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:02.534077 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:02.534211 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 06:43:02.534349 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
I20260810 06:43:02.534507 14849 ts_manager.cc:194] Registered new tserver with Master: dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079)
I20260810 06:43:02.534968 14849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:51913
I20260810 06:43:02.535261 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:43:02.538300 15491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.535637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33594 (local address 127.27.41.190:46465)
0810 06:43:02.535669 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:02.535671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:02.535801 (+ 130us) server_negotiation.cc:407] Connection header received
0810 06:43:02.535886 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:02.535887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:02.535934 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:02.536019 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:43:02.536116 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.536660 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.537485 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.537705 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.537791 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.537983 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:43:02.538081 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:43:02.538185 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:02.538210 (+ 25us) server_negotiation.cc:299] Negotiation successful
0810 06:43:02.538231 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260810 06:43:02.538542 14848 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:33594:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:43:02.540138 14848 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:43:02.542398 15013 tablet_service.cc:1467] Processing CreateTablet for tablet 0008922944e64361b903f3d26a912f5a (DEFAULT_TABLE table=test-table [id=1c72fde548934185aaa521455e2dd17a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:43:02.542630 15013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0008922944e64361b903f3d26a912f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:02.543884 14958 tablet_bootstrap.cc:492] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3: Bootstrap starting.
I20260810 06:43:02.544209 14958 tablet_bootstrap.cc:654] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:02.545167 14958 tablet_bootstrap.cc:492] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3: No bootstrap required, opened a new log
I20260810 06:43:02.545224 14958 ts_tablet_manager.cc:1397] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:02.545454 14958 raft_consensus.cc:348] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:02.545533 14958 raft_consensus.cc:374] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:02.545588 14958 raft_consensus.cc:729] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff35ea807d7445e3bf4d683b695d49a3, State: Initialized, Role: FOLLOWER
I20260810 06:43:02.545639 14958 consensus_queue.cc:260] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:02.545735 14958 ts_tablet_manager.cc:1428] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:02.546269 15116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.541953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:34079 (local address 127.0.0.1:55604)
0810 06:43:02.542022 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:02.542033 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:02.542081 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:02.542417 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:02.542418 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:02.542419 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:02.542458 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.542460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.543753 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.543754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.544979 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.544982 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.545998 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.545999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.546067 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.546082 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 06:43:02.546153 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 06:43:02.546200 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":35}
I20260810 06:43:02.546696 15493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.541954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:43767 (local address 127.0.0.1:60096)
0810 06:43:02.542267 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:02.542278 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:02.542322 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:02.542698 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:02.542757 (+ 59us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:02.542760 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:02.542803 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.542805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.543995 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.543996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.545074 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.545076 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.546455 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.546456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.546527 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.546531 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:43:02.546592 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 06:43:02.546631 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":24,"thread_start_us":80,"threads_started":1}
I20260810 06:43:02.546718 15495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.542061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55604 (local address 127.27.41.131:34079)
0810 06:43:02.542243 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:02.542249 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:02.542257 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:43:02.542294 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:02.542296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:02.542310 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:02.542396 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:02.542541 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.543590 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.545093 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.545820 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.545895 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.545967 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:02.546604 (+ 637us) server_negotiation.cc:299] Negotiation successful
0810 06:43:02.546645 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":92,"threads_started":1}
I20260810 06:43:02.547158 15496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.542162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60096 (local address 127.27.41.130:43767)
0810 06:43:02.542536 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:02.542541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:02.542551 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:43:02.542589 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:02.542591 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:02.542608 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:02.542686 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:02.542891 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.543891 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.545158 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.546272 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.546453 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.546536 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:02.546686 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 06:43:02.546732 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":113,"threads_started":1}
I20260810 06:43:02.547370 15388 tablet_service.cc:1467] Processing CreateTablet for tablet 0008922944e64361b903f3d26a912f5a (DEFAULT_TABLE table=test-table [id=1c72fde548934185aaa521455e2dd17a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:43:02.547691 15388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0008922944e64361b903f3d26a912f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:02.547788 15204 tablet_service.cc:1467] Processing CreateTablet for tablet 0008922944e64361b903f3d26a912f5a (DEFAULT_TABLE table=test-table [id=1c72fde548934185aaa521455e2dd17a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:43:02.548261 15204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0008922944e64361b903f3d26a912f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:02.550619 15498 tablet_bootstrap.cc:492] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a: Bootstrap starting.
I20260810 06:43:02.551182 15498 tablet_bootstrap.cc:654] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:02.551343 15499 tablet_bootstrap.cc:492] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292: Bootstrap starting.
I20260810 06:43:02.551731 15498 log.cc:824] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:02.552062 15499 tablet_bootstrap.cc:654] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:02.552569 15498 tablet_bootstrap.cc:492] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a: No bootstrap required, opened a new log
I20260810 06:43:02.552670 15499 log.cc:824] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:02.552666 15498 ts_tablet_manager.cc:1397] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:43:02.553537 15499 tablet_bootstrap.cc:492] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292: No bootstrap required, opened a new log
I20260810 06:43:02.553615 15499 ts_tablet_manager.cc:1397] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:43:02.554754 15498 raft_consensus.cc:348] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:02.554927 15498 raft_consensus.cc:374] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:02.554982 15498 raft_consensus.cc:729] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc888a5ea15f4fad81302482c9cc9d7a, State: Initialized, Role: FOLLOWER
I20260810 06:43:02.555110 15498 consensus_queue.cc:260] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:02.555406 15498 ts_tablet_manager.cc:1428] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:43:02.555526 15487 heartbeater.cc:503] Master 127.27.41.190:46465 was elected leader, sending a full tablet report...
I20260810 06:43:02.555706 15499 raft_consensus.cc:348] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:02.555840 15499 raft_consensus.cc:374] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:02.555867 15499 raft_consensus.cc:729] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f60721dd90b4be3948c10da2ef9c292, State: Initialized, Role: FOLLOWER
I20260810 06:43:02.555992 15499 consensus_queue.cc:260] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:02.556308 15305 heartbeater.cc:503] Master 127.27.41.190:46465 was elected leader, sending a full tablet report...
I20260810 06:43:02.556298 15499 ts_tablet_manager.cc:1428] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
W20260810 06:43:02.645325 15306 tablet.cc:2369] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:43:02.761767 15110 tablet.cc:2369] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:43:02.773507 15488 tablet.cc:2369] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:43:02.854725 15118 raft_consensus.cc:482] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:43:02.854938 15118 raft_consensus.cc:504] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:02.855432 15118 leader_election.cc:288] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767), dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079)
I20260810 06:43:02.858659 15495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.855765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:50549 (local address 127.27.41.131:34079)
0810 06:43:02.855815 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:02.855817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:02.855878 (+ 61us) server_negotiation.cc:407] Connection header received
0810 06:43:02.856044 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:02.856045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:02.856073 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:02.856142 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:02.856330 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.856832 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.857827 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.858239 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.858302 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.858310 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:02.858515 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 06:43:02.858577 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 06:43:02.858676 15496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.855731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:33653 (local address 127.27.41.130:43767)
0810 06:43:02.855781 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:02.855784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:02.855902 (+ 118us) server_negotiation.cc:407] Connection header received
0810 06:43:02.856010 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:02.856011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:02.856021 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:02.856088 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:02.856284 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.856772 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.857905 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.858291 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.858367 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.858374 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:02.858582 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 06:43:02.858619 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 06:43:02.858660 15504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.855652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:34079 (local address 127.27.41.129:50549)
0810 06:43:02.855811 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:02.855820 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:02.855922 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:02.856154 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:02.856156 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:02.856158 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:02.856233 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.856235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.856921 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.856922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.857736 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.857738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.858327 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.858328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.858402 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.858427 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 06:43:02.858481 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 06:43:02.858516 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":31,"thread_start_us":81,"threads_started":1}
I20260810 06:43:02.858686 15505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.855632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:43767 (local address 127.27.41.129:33653)
0810 06:43:02.855809 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:02.855821 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:02.855919 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:02.856105 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:02.856106 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:02.856109 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:02.856200 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.856202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.856862 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.856863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.857803 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:02.857807 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.858399 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.858400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:02.858479 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.858485 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:43:02.858562 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 06:43:02.858600 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":62,"thread_start_us":95,"threads_started":1}
I20260810 06:43:02.859052 15419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0008922944e64361b903f3d26a912f5a" candidate_uuid: "ff35ea807d7445e3bf4d683b695d49a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" is_pre_election: true
I20260810 06:43:02.859227 15419 raft_consensus.cc:2454] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff35ea807d7445e3bf4d683b695d49a3 in term 0.
I20260810 06:43:02.859256 15232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0008922944e64361b903f3d26a912f5a" candidate_uuid: "ff35ea807d7445e3bf4d683b695d49a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f60721dd90b4be3948c10da2ef9c292" is_pre_election: true
I20260810 06:43:02.859460 15232 raft_consensus.cc:2454] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff35ea807d7445e3bf4d683b695d49a3 in term 0.
I20260810 06:43:02.859485 14952 leader_election.cc:302] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc888a5ea15f4fad81302482c9cc9d7a, ff35ea807d7445e3bf4d683b695d49a3; no voters:
I20260810 06:43:02.859606 15118 raft_consensus.cc:2781] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:43:02.859676 15118 raft_consensus.cc:482] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:43:02.859704 15118 raft_consensus.cc:3037] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:02.860431 15118 raft_consensus.cc:504] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:02.860579 15118 leader_election.cc:288] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 1 election: Requested vote from peers 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767), dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079)
I20260810 06:43:02.860729 15232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0008922944e64361b903f3d26a912f5a" candidate_uuid: "ff35ea807d7445e3bf4d683b695d49a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f60721dd90b4be3948c10da2ef9c292"
I20260810 06:43:02.860738 15419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0008922944e64361b903f3d26a912f5a" candidate_uuid: "ff35ea807d7445e3bf4d683b695d49a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc888a5ea15f4fad81302482c9cc9d7a"
I20260810 06:43:02.860818 15232 raft_consensus.cc:3037] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:02.860836 15419 raft_consensus.cc:3037] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:02.861681 15419 raft_consensus.cc:2454] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff35ea807d7445e3bf4d683b695d49a3 in term 1.
I20260810 06:43:02.861686 15232 raft_consensus.cc:2454] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff35ea807d7445e3bf4d683b695d49a3 in term 1.
I20260810 06:43:02.861900 14952 leader_election.cc:302] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dc888a5ea15f4fad81302482c9cc9d7a, ff35ea807d7445e3bf4d683b695d49a3; no voters:
I20260810 06:43:02.862033 15118 raft_consensus.cc:2781] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:43:02.862191 15118 raft_consensus.cc:686] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 LEADER]: Becoming Leader. State: Replica: ff35ea807d7445e3bf4d683b695d49a3, State: Running, Role: LEADER
I20260810 06:43:02.862255 15118 consensus_queue.cc:237] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:02.863145 14848 catalog_manager.cc:5495] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff35ea807d7445e3bf4d683b695d49a3 (127.27.41.129). New cstate: current_term: 1 leader_uuid: "ff35ea807d7445e3bf4d683b695d49a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } health_report { overall_health: HEALTHY } } }
I20260810 06:43:02.900802 15510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.898442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51696 (local address 127.27.41.129:43621)
0810 06:43:02.898620 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:02.898622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:02.898631 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:43:02.898674 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:02.898674 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:02.898694 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:02.898764 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:43:02.898890 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.899394 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.900099 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:02.900281 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:02.900330 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:02.900481 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:43:02.900578 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:43:02.900630 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:02.900671 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 06:43:02.900689 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":101,"threads_started":1}
I20260810 06:43:02.902482 15419 raft_consensus.cc:1261] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a [term 1 FOLLOWER]: Refusing update from remote peer ff35ea807d7445e3bf4d683b695d49a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:43:02.902501 15232 raft_consensus.cc:1261] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292 [term 1 FOLLOWER]: Refusing update from remote peer ff35ea807d7445e3bf4d683b695d49a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:43:02.902902 15506 consensus_queue.cc:1035] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:43:02.903038 15118 consensus_queue.cc:1035] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:43:02.905396 15512 mvcc.cc:205] Tried to move back new op lower bound from 7316865773165957120 to 7316865773004521472. Current Snapshot: MvccSnapshot[applied={T|T < 7316865773165957120}]
I20260810 06:43:02.907897 14849 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:33594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:43:02.907996 14849 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:33594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:43:02.908794 14849 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Sending DeleteTablet for 3 replicas of tablet 0008922944e64361b903f3d26a912f5a
I20260810 06:43:02.909144 15013 tablet_service.cc:1514] Processing DeleteTablet for tablet 0008922944e64361b903f3d26a912f5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:02 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:47478
I20260810 06:43:02.909154 15388 tablet_service.cc:1514] Processing DeleteTablet for tablet 0008922944e64361b903f3d26a912f5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:02 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:55604
I20260810 06:43:02.909372 15011 tablet_service.cc:1514] Processing DeleteTablet for tablet 0008922944e64361b903f3d26a912f5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:02 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:47478
I20260810 06:43:02.909427 15204 tablet_service.cc:1514] Processing DeleteTablet for tablet 0008922944e64361b903f3d26a912f5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:02 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:60096
I20260810 06:43:02.909679 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 14900
I20260810 06:43:02.909699 15526 tablet_replica.cc:330] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292: stopping tablet replica
I20260810 06:43:02.915462 15525 tablet_replica.cc:330] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a: stopping tablet replica
I20260810 06:43:02.915592 15525 raft_consensus.cc:2229] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:43:02.915704 15525 raft_consensus.cc:2258] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:43:02.916064 15526 raft_consensus.cc:2229] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:43:02.916206 15526 raft_consensus.cc:2258] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:43:02.916205 15525 ts_tablet_manager.cc:1905] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:43:02.916597 15526 ts_tablet_manager.cc:1905] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:43:02.918140 15526 ts_tablet_manager.cc:1918] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:43:02.918218 15526 log.cc:1196] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/0008922944e64361b903f3d26a912f5a
I20260810 06:43:02.918284 15525 ts_tablet_manager.cc:1918] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:43:02.918361 15525 log.cc:1196] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/0008922944e64361b903f3d26a912f5a
I20260810 06:43:02.918489 15526 ts_tablet_manager.cc:1939] T 0008922944e64361b903f3d26a912f5a P 9f60721dd90b4be3948c10da2ef9c292: Deleting consensus metadata
I20260810 06:43:02.918680 15525 ts_tablet_manager.cc:1939] T 0008922944e64361b903f3d26a912f5a P dc888a5ea15f4fad81302482c9cc9d7a: Deleting consensus metadata
I20260810 06:43:02.918889 14823 catalog_manager.cc:4841] TS 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767): tablet 0008922944e64361b903f3d26a912f5a (table test-table [id=1c72fde548934185aaa521455e2dd17a]) successfully deleted
I20260810 06:43:02.919107 14824 catalog_manager.cc:4841] TS dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079): tablet 0008922944e64361b903f3d26a912f5a (table test-table [id=1c72fde548934185aaa521455e2dd17a]) successfully deleted
W20260810 06:43:02.923043 14823 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:43621 (error 108)
I20260810 06:43:02.923252 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 15114
I20260810 06:43:02.924898 15493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:02.923420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:43621 (local address 127.0.0.1:51710)
0810 06:43:02.924807 (+ 1387us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:02.924854 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:43621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1364}
W20260810 06:43:02.925103 14823 catalog_manager.cc:4584] TS ff35ea807d7445e3bf4d683b695d49a3 (127.27.41.129:43621): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0008922944e64361b903f3d26a912f5a: Network error: Client connection negotiation failed: client connection to 127.27.41.129:43621: connect: Connection refused (error 111)
I20260810 06:43:02.931823 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 15308
I20260810 06:43:02.940419 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 14803
I20260810 06:43:02.951828 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:46465
--webserver_interface=127.27.41.190
--webserver_port=44783
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:46465
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:43:03.036418 15529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:03.036659 15529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:03.036698 15529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:03.037961 15529 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:43:03.038026 15529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:03.038050 15529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:03.038089 15529 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:43:03.038116 15529 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:43:03.039644 15529 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:46465
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:46465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=44783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:03.039933 15529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:03.040162 15529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:03.045138 15536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:03.045166 15535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:03.045145 15538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:03.045245 15529 server_base.cc:1034] running on GCE node
I20260810 06:43:03.045688 15529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:03.046008 15529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:03.047184 15529 hybrid_clock.cc:648] HybridClock initialized: now 1786344183047181 us; error 38 us; skew 500 ppm
Aug 10 06:43:03 dist-test-slave-bw88 krb5kdc[14027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344183, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:03.049873 15529 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:43:03.050308 15529 webserver.cc:460] Webserver started at http://127.27.41.190:44783/ using document root <none> and password file <none>
I20260810 06:43:03.050566 15529 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:03.050640 15529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:03.051977 15529 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:03.052714 15553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:03.052906 15529 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:03.052994 15529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "e5e0075da75a4c8785637e44ca351f44"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "f9680df689c945cbf20e43c00f18f78f"
server_key_iv: "dcbf4523692e17283864df663ddf2f4e"
server_key_version: "encryptionkey@0"
I20260810 06:43:03.053344 15529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:03.064965 15529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:03.067349 15529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:03.067514 15529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:03.071686 15529 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:46465
I20260810 06:43:03.071722 15625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:46465 every 8 connection(s)
I20260810 06:43:03.072140 15529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:43:03.073871 15626 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:43:03.074573 15626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Bootstrap starting.
I20260810 06:43:03.077256 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 15529
I20260810 06:43:03.077597 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:43621
--local_ip_for_outbound_sockets=127.27.41.129
--tserver_master_addrs=127.27.41.190:46465
--webserver_port=43411
--webserver_interface=127.27.41.129
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:43:03.085141 15626 log.cc:824] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:03.088989 15626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:43:03.089416 15626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44: Bootstrap complete.
I20260810 06:43:03.093254 15626 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } }
I20260810 06:43:03.093647 15626 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e0075da75a4c8785637e44ca351f44, State: Initialized, Role: FOLLOWER
I20260810 06:43:03.093840 15626 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } }
I20260810 06:43:03.093930 15626 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:43:03.093979 15626 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:43:03.094027 15626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 2 FOLLOWER]: Advancing to term 3
I20260810 06:43:03.095307 15626 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } }
I20260810 06:43:03.095425 15626 leader_election.cc:302] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5e0075da75a4c8785637e44ca351f44; no voters:
I20260810 06:43:03.095621 15626 leader_election.cc:288] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 06:43:03.095696 15631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 06:43:03.095855 15631 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [term 3 LEADER]: Becoming Leader. State: Replica: e5e0075da75a4c8785637e44ca351f44, State: Running, Role: LEADER
I20260810 06:43:03.095922 15626 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:43:03.095961 15631 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } }
I20260810 06:43:03.096210 15631 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5e0075da75a4c8785637e44ca351f44. Latest consensus state: current_term: 3 leader_uuid: "e5e0075da75a4c8785637e44ca351f44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } } }
I20260810 06:43:03.096331 15631 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: This master's current role is: LEADER
I20260810 06:43:03.096211 15632 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e5e0075da75a4c8785637e44ca351f44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e0075da75a4c8785637e44ca351f44" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 46465 } } }
I20260810 06:43:03.096480 15632 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5e0075da75a4c8785637e44ca351f44 [sys.catalog]: This master's current role is: LEADER
I20260810 06:43:03.096578 15637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:43:03.097610 15637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:43:03.097713 15637 catalog_manager.cc:1259] Loaded cluster ID: f8d8a4cfb47349c29136bbad0edcaf61
I20260810 06:43:03.097752 15637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260810 06:43:03.098286 15637 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f19dc5c39ad google::LogMessage::Fail() at ??:0
@ 0x7f19dc5c688a google::LogMessage::SendToLog() at ??:0
@ 0x7f19dc5c34de google::LogMessage::Flush() at ??:0
@ 0x7f19dc5c4a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f19e44e40f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f19e44ed8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f19de4910d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f19de486954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f19df2ea6db start_thread at ??:0
@ 0x7f19db0c161f clone at ??:0
W20260810 06:43:03.177542 15629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:03.177754 15629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:03.177790 15629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:03.178875 15629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:03.178937 15629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:03.178979 15629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:43:03.180411 15629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:43621
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=43411
--tserver_master_addrs=127.27.41.190:46465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:03.180687 15629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:03.180919 15629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:03.187316 15687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:03.187330 15681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:03.187328 15680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:03.187598 15629 server_base.cc:1034] running on GCE node
I20260810 06:43:03.187793 15629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:03.188056 15629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:03.189216 15629 hybrid_clock.cc:648] HybridClock initialized: now 1786344183189192 us; error 42 us; skew 500 ppm
Aug 10 06:43:03 dist-test-slave-bw88 krb5kdc[14027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344183, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:03.191828 15629 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:43:03.192294 15629 webserver.cc:460] Webserver started at http://127.27.41.129:43411/ using document root <none> and password file <none>
I20260810 06:43:03.192545 15629 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:03.192617 15629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:03.194064 15629 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:03.194818 15697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:03.195027 15629 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:03.195137 15629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "ff35ea807d7445e3bf4d683b695d49a3"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "93c94a594ddc93fee828f2bf7780ac6b"
server_key_iv: "e179dcaa70788f1c20b6ebe9e8652ed9"
server_key_version: "encryptionkey@0"
I20260810 06:43:03.195492 15629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:03.213258 15629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:03.215668 15629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:03.215840 15629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:03.216091 15629 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:03.216555 15708 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 06:43:03.218528 15629 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 06:43:03.218587 15629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 06:43:03.218627 15629 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 06:43:03.219277 15629 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 06:43:03.219331 15629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 06:43:03.219398 15708 tablet_bootstrap.cc:492] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3: Bootstrap starting.
I20260810 06:43:03.226922 15629 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:43621
I20260810 06:43:03.227077 15867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:43621 every 8 connection(s)
I20260810 06:43:03.227360 15629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:43:03.231626 15708 log.cc:824] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:03.234299 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 15629
I20260810 06:43:03.234603 15708 tablet_bootstrap.cc:492] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:43:03.234627 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:43767
--local_ip_for_outbound_sockets=127.27.41.130
--tserver_master_addrs=127.27.41.190:46465
--webserver_port=33705
--webserver_interface=127.27.41.130
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:43:03.234927 15708 tablet_bootstrap.cc:492] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3: Bootstrap complete.
I20260810 06:43:03.236322 15708 ts_tablet_manager.cc:1397] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.009s
I20260810 06:43:03.238045 15708 raft_consensus.cc:348] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:03.238435 15708 raft_consensus.cc:729] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff35ea807d7445e3bf4d683b695d49a3, State: Initialized, Role: FOLLOWER
I20260810 06:43:03.238602 15708 consensus_queue.cc:260] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:03.238873 15708 ts_tablet_manager.cc:1428] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
W20260810 06:43:03.288988 15873 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:43:03.227994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:56407)
0810 06:43:03.228161 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:03.228203 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:03.228671 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:03.288752 (+ 60081us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":100,"threads_started":1}
W20260810 06:43:03.289287 15868 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:46465 (0 consecutive failures): Network error: Failed to ping master at 127.27.41.190:46465: Client connection negotiation failed: client connection to 127.27.41.190:46465: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 06:43:03.289654 15873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:03.289530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:57413)
0810 06:43:03.289586 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:03.289634 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 06:43:03.289973 15873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:03.289887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:54057)
0810 06:43:03.289929 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:03.289950 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 06:43:03.290096 15868 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:43:03.318239 15875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:03.318420 15875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:03.318444 15875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:03.319528 15875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:03.319567 15875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:03.319592 15875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:43:03.321105 15875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:43767
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=33705
--tserver_master_addrs=127.27.41.190:46465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:03.321346 15875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:03.321605 15875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:03.326788 15885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:03.326793 15888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:03.326817 15886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:03.327073 15875 server_base.cc:1034] running on GCE node
I20260810 06:43:03.327253 15875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:03.327509 15875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:03.328702 15875 hybrid_clock.cc:648] HybridClock initialized: now 1786344183328697 us; error 37 us; skew 500 ppm
Aug 10 06:43:03 dist-test-slave-bw88 krb5kdc[14027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344183, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:03.331307 15875 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:43:03.331745 15875 webserver.cc:460] Webserver started at http://127.27.41.130:33705/ using document root <none> and password file <none>
I20260810 06:43:03.331980 15875 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:03.332053 15875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:03.333432 15875 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:43:03.334043 15897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:03.334219 15875 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:43:03.334319 15875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "9f60721dd90b4be3948c10da2ef9c292"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "7a81d84dd495dbbba8223f32fed80598"
server_key_iv: "8e2a221a005c959dc3da16db5c3320fd"
server_key_version: "encryptionkey@0"
I20260810 06:43:03.334686 15875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:03.350256 15875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:03.352169 15875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:03.352344 15875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:03.352583 15875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:03.352895 15875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:43:03.352952 15875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:03.352994 15875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:43:03.353021 15875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:03.359247 15875 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:43767
I20260810 06:43:03.359299 16065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:43767 every 8 connection(s)
I20260810 06:43:03.359690 15875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:43:03.360786 16069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:03.360414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:41333)
0810 06:43:03.360574 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:03.360649 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
W20260810 06:43:03.361279 16066 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:46465 (0 consecutive failures): Network error: Failed to ping master at 127.27.41.190:46465: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
I20260810 06:43:03.361274 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 15875
I20260810 06:43:03.361604 16069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:03.361487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:43697)
0810 06:43:03.361542 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:03.361574 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 06:43:03.361622 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:34079
--local_ip_for_outbound_sockets=127.27.41.131
--tserver_master_addrs=127.27.41.190:46465
--webserver_port=42179
--webserver_interface=127.27.41.131
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:43:03.362099 16069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:03.361991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:58641)
0810 06:43:03.362042 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:03.362071 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 06:43:03.362255 16066 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:43:03.445554 16070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:03.445734 16070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:03.445755 16070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:03.446781 16070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:03.446815 16070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:03.446839 16070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:43:03.448211 16070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:34079
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=42179
--tserver_master_addrs=127.27.41.190:46465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:03.448397 16070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:03.448575 16070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:03.453608 16082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:03.453647 16077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:03.453651 16079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:03.453668 16070 server_base.cc:1034] running on GCE node
I20260810 06:43:03.454003 16070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:03.454293 16070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:03.455466 16070 hybrid_clock.cc:648] HybridClock initialized: now 1786344183455440 us; error 38 us; skew 500 ppm
Aug 10 06:43:03 dist-test-slave-bw88 krb5kdc[14027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344183, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:03.458016 16070 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:43:03.458468 16070 webserver.cc:460] Webserver started at http://127.27.41.131:42179/ using document root <none> and password file <none>
I20260810 06:43:03.458726 16070 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:03.458774 16070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:03.460155 16070 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:03.460803 16091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:03.461000 16070 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:03.461098 16070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "dc888a5ea15f4fad81302482c9cc9d7a"
format_stamp: "Formatted at 2026-08-10 06:43:01 on dist-test-slave-bw88"
server_key: "39ef30a9696cab0ee9730d910c1f4924"
server_key_iv: "d55b8f21b02e6dae9a468f37113b6c12"
server_key_version: "encryptionkey@0"
I20260810 06:43:03.461464 16070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:03.479925 16070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:03.481853 16070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:03.481976 16070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:03.482147 16070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:03.482466 16070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:43:03.482501 16070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:03.482522 16070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:43:03.482568 16070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:03.488548 16070 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:34079
I20260810 06:43:03.488591 16252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:34079 every 8 connection(s)
I20260810 06:43:03.488907 16070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:43:03.489908 16256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:03.489546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:56189)
0810 06:43:03.489708 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:03.489779 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
W20260810 06:43:03.490300 16253 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:46465 (0 consecutive failures): Network error: Failed to ping master at 127.27.41.190:46465: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
I20260810 06:43:03.490568 16256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:03.490476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:54319)
0810 06:43:03.490527 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:03.490552 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 06:43:03.490820 16256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:03.490772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:48173)
0810 06:43:03.490792 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:03.490809 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260810 06:43:03.490931 16253 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 06:43:03.497789 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 16070
I20260810 06:43:04.290666 16258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:04.290431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:51085)
0810 06:43:04.290564 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:04.290603 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":60,"threads_started":1}
I20260810 06:43:04.362754 16260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:04.362562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:37723)
0810 06:43:04.362676 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:04.362709 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":58,"threads_started":1}
I20260810 06:43:04.491537 16261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:04.491328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:46721)
0810 06:43:04.491458 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:04.491490 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
I20260810 06:43:04.515259 16263 raft_consensus.cc:482] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:43:04.515389 16263 raft_consensus.cc:504] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:04.515810 16263 leader_election.cc:288] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767), dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079)
Aug 10 06:43:04 dist-test-slave-bw88 krb5kdc[14027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344183, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.131@KRBTEST.COM
Aug 10 06:43:04 dist-test-slave-bw88 krb5kdc[14027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344183, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.130@KRBTEST.COM
I20260810 06:43:04.526758 16258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:04.515973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:34079 (local address 127.27.41.129:48901)
0810 06:43:04.516028 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:04.516042 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:04.516101 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:04.517233 (+ 1132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:04.517236 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:04.517730 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:04.517916 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:04.517922 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:04.519034 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:04.519035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:04.519840 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:04.519842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:04.520437 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:04.520439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:04.520565 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:04.521251 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:04.521255 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:04.522846 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:04.525188 (+ 2342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:04.525195 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:04.525197 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:04.525469 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:04.525775 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:04.525775 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:04.525776 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:04.525879 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:04.526262 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:04.526269 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:04.526386 (+ 117us) client_negotiation.cc:769] Sending connection context
0810 06:43:04.526491 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 06:43:04.526659 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":2}
I20260810 06:43:04.526793 16265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:04.516133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:48901 (local address 127.27.41.131:34079)
0810 06:43:04.516410 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:04.516422 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:04.516459 (+ 37us) server_negotiation.cc:407] Connection header received
0810 06:43:04.516995 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:04.516998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:04.517042 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:04.517203 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:04.518041 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:04.518924 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:04.519945 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:04.520343 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:04.520464 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:04.522974 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:04.522978 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:04.522979 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:04.522989 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:04.525096 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:04.525603 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:04.525605 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:04.525605 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:04.525695 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:04.525954 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:04.525955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:04.525956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:04.526179 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:04.526269 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:04.526559 (+ 290us) server_negotiation.cc:299] Negotiation successful
0810 06:43:04.526693 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":88,"threads_started":1}
I20260810 06:43:04.527122 16264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:04.515982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:43767 (local address 127.27.41.129:55691)
0810 06:43:04.516242 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:04.516253 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:04.516317 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:04.517243 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:04.517244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:04.517730 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:04.517916 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:04.517922 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:04.519073 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:04.519074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:04.519843 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:04.519845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:04.520455 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:04.520456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:04.520560 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:04.521189 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:04.521198 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:04.523237 (+ 2039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:04.525506 (+ 2269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:04.525507 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:04.525508 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:04.525699 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:04.525989 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:04.525990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:04.525991 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:04.526062 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:04.526455 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:04.526456 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:04.526508 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 06:43:04.526596 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 06:43:04.527030 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":364,"thread_start_us":90,"threads_started":1}
I20260810 06:43:04.527580 16266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:04.516217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:55691 (local address 127.27.41.130:43767)
0810 06:43:04.516511 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:04.516523 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:04.516562 (+ 39us) server_negotiation.cc:407] Connection header received
0810 06:43:04.517036 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:04.517038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:04.517077 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:04.517229 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:04.518048 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:04.518939 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:04.519961 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:04.520345 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:04.520484 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:04.523353 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:04.523358 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:04.523358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:04.523376 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:04.525401 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:04.525801 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:04.525804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:04.525805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:04.525911 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:04.526135 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:04.526136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:04.526136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:04.526363 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:04.526457 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:04.526661 (+ 204us) server_negotiation.cc:299] Negotiation successful
0810 06:43:04.527428 (+ 767us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":54,"threads_started":1}
W20260810 06:43:04.527678 15699 leader_election.cc:341] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079): Not found: Tablet not found: 0008922944e64361b903f3d26a912f5a
W20260810 06:43:04.528275 15698 leader_election.cc:341] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767): Not found: Tablet not found: 0008922944e64361b903f3d26a912f5a
I20260810 06:43:04.528327 15698 leader_election.cc:302] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff35ea807d7445e3bf4d683b695d49a3; no voters: 9f60721dd90b4be3948c10da2ef9c292, dc888a5ea15f4fad81302482c9cc9d7a
I20260810 06:43:04.528424 16263 raft_consensus.cc:2726] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:43:05.291383 16267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:05.291123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:57661)
0810 06:43:05.291267 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:05.291307 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":81,"threads_started":1}
I20260810 06:43:05.363484 16272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:05.363259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:46227)
0810 06:43:05.363412 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:05.363449 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":77,"threads_started":1}
I20260810 06:43:05.492107 16275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:05.491932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:41129)
0810 06:43:05.492043 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:05.492074 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":57,"threads_started":1}
I20260810 06:43:06.292208 16276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:06.291877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:51691)
0810 06:43:06.292123 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:06.292160 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":70,"threads_started":1}
I20260810 06:43:06.364207 16278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:06.363967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:57149)
0810 06:43:06.364099 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:06.364140 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":85,"threads_started":1}
I20260810 06:43:06.492863 16279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:06.492649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:53845)
0810 06:43:06.492781 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:06.492820 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":68,"threads_started":1}
I20260810 06:43:06.541641 16280 raft_consensus.cc:482] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:43:06.541757 16280 raft_consensus.cc:504] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:06.541950 16280 leader_election.cc:288] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767), dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079)
W20260810 06:43:06.542397 15698 leader_election.cc:341] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767): Not found: Tablet not found: 0008922944e64361b903f3d26a912f5a
W20260810 06:43:06.542505 15699 leader_election.cc:341] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079): Not found: Tablet not found: 0008922944e64361b903f3d26a912f5a
I20260810 06:43:06.542599 15699 leader_election.cc:302] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff35ea807d7445e3bf4d683b695d49a3; no voters: 9f60721dd90b4be3948c10da2ef9c292, dc888a5ea15f4fad81302482c9cc9d7a
I20260810 06:43:06.542693 16280 raft_consensus.cc:2726] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:43:07.292914 16281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:07.292703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:44357)
0810 06:43:07.292831 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:07.292867 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":67,"threads_started":1}
I20260810 06:43:07.364894 16282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:07.364693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:50447)
0810 06:43:07.364825 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:07.364857 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260810 06:43:07.493681 16283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:07.493476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:41767)
0810 06:43:07.493600 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:07.493645 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":56,"threads_started":1}
I20260810 06:43:08.293686 16285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:08.293449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:35381)
0810 06:43:08.293604 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:08.293638 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":64,"threads_started":1}
I20260810 06:43:08.365649 16286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:08.365320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:44919)
0810 06:43:08.365558 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:08.365599 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":129,"threads_started":1}
I20260810 06:43:08.494287 16287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:08.494088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:50263)
0810 06:43:08.494210 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:08.494245 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":60,"threads_started":1}
I20260810 06:43:08.945320 16288 raft_consensus.cc:482] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:43:08.945499 16288 raft_consensus.cc:504] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:08.945731 16288 leader_election.cc:288] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767), dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079)
W20260810 06:43:08.946130 15698 leader_election.cc:341] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767): Not found: Tablet not found: 0008922944e64361b903f3d26a912f5a
W20260810 06:43:08.946234 15699 leader_election.cc:341] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079): Not found: Tablet not found: 0008922944e64361b903f3d26a912f5a
I20260810 06:43:08.946269 15699 leader_election.cc:302] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff35ea807d7445e3bf4d683b695d49a3; no voters: 9f60721dd90b4be3948c10da2ef9c292, dc888a5ea15f4fad81302482c9cc9d7a
I20260810 06:43:08.946372 16288 raft_consensus.cc:2726] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:43:09.294441 16289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:09.294196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:58589)
0810 06:43:09.294350 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:09.294391 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":91,"threads_started":1}
I20260810 06:43:09.366291 16290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:09.366086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:33715)
0810 06:43:09.366220 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:09.366254 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260810 06:43:09.494956 16291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:09.494741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:47809)
0810 06:43:09.494875 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:09.494913 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":68,"threads_started":1}
I20260810 06:43:10.295159 16292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:10.294936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:40843)
0810 06:43:10.295076 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:10.295112 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":64,"threads_started":1}
I20260810 06:43:10.366978 16293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:10.366751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:46375)
0810 06:43:10.366901 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:10.366934 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":83,"threads_started":1}
I20260810 06:43:10.495669 16295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:10.495425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:34519)
0810 06:43:10.495582 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:10.495622 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":74,"threads_started":1}
I20260810 06:43:11.295918 16296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:11.295689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:60843)
0810 06:43:11.295835 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:11.295871 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":69,"threads_started":1}
I20260810 06:43:11.367574 16298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:11.367379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:48663)
0810 06:43:11.367496 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:11.367531 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":62,"threads_started":1}
I20260810 06:43:11.496376 16299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:11.496163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:44371)
0810 06:43:11.496296 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:11.496335 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":62,"threads_started":1}
I20260810 06:43:12.296626 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:12.296407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:51761)
0810 06:43:12.296540 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:12.296578 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260810 06:43:12.368222 16302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:12.368020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:33791)
0810 06:43:12.368149 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:12.368182 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":70,"threads_started":1}
I20260810 06:43:12.497093 16304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:12.496849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:52415)
0810 06:43:12.496988 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:12.497028 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
I20260810 06:43:13.198051 16305 raft_consensus.cc:482] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:43:13.198150 16305 raft_consensus.cc:504] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:13.198359 16305 leader_election.cc:288] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767), dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079)
W20260810 06:43:13.198779 15698 leader_election.cc:341] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767): Not found: Tablet not found: 0008922944e64361b903f3d26a912f5a
W20260810 06:43:13.198854 15699 leader_election.cc:341] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079): Not found: Tablet not found: 0008922944e64361b903f3d26a912f5a
I20260810 06:43:13.198925 15699 leader_election.cc:302] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff35ea807d7445e3bf4d683b695d49a3; no voters: 9f60721dd90b4be3948c10da2ef9c292, dc888a5ea15f4fad81302482c9cc9d7a
I20260810 06:43:13.199029 16305 raft_consensus.cc:2726] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:43:13.297461 16306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:13.297132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:53825)
0810 06:43:13.297375 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:13.297413 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":69,"threads_started":1}
I20260810 06:43:13.369051 16308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:13.368702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:34645)
0810 06:43:13.368975 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:13.369010 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":76,"threads_started":1}
I20260810 06:43:13.497853 16309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:13.497589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:57047)
0810 06:43:13.497751 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:13.497790 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":106,"threads_started":1}
I20260810 06:43:14.298211 16310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:14.297983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:41117)
0810 06:43:14.298117 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:14.298152 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
I20260810 06:43:14.369745 16311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:14.369556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:36705)
0810 06:43:14.369679 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:14.369709 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":70,"threads_started":1}
I20260810 06:43:14.498638 16312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:14.498400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:44793)
0810 06:43:14.498545 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:14.498592 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":61,"threads_started":1}
I20260810 06:43:15.080364 16313 raft_consensus.cc:482] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:43:15.080498 16313 raft_consensus.cc:504] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60721dd90b4be3948c10da2ef9c292" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 43767 } } peers { permanent_uuid: "dc888a5ea15f4fad81302482c9cc9d7a" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 34079 } } peers { permanent_uuid: "ff35ea807d7445e3bf4d683b695d49a3" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 43621 } }
I20260810 06:43:15.080703 16313 leader_election.cc:288] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767), dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079)
W20260810 06:43:15.081027 15699 leader_election.cc:341] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dc888a5ea15f4fad81302482c9cc9d7a (127.27.41.131:34079): Not found: Tablet not found: 0008922944e64361b903f3d26a912f5a
W20260810 06:43:15.081123 15698 leader_election.cc:341] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9f60721dd90b4be3948c10da2ef9c292 (127.27.41.130:43767): Not found: Tablet not found: 0008922944e64361b903f3d26a912f5a
I20260810 06:43:15.081216 15698 leader_election.cc:302] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff35ea807d7445e3bf4d683b695d49a3; no voters: 9f60721dd90b4be3948c10da2ef9c292, dc888a5ea15f4fad81302482c9cc9d7a
I20260810 06:43:15.081295 16313 raft_consensus.cc:2726] T 0008922944e64361b903f3d26a912f5a P ff35ea807d7445e3bf4d683b695d49a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:43:15.298877 16314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:15.298667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:47417)
0810 06:43:15.298794 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:15.298830 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260810 06:43:15.370390 16315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:15.370176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:55969)
0810 06:43:15.370314 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:15.370351 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":79,"threads_started":1}
I20260810 06:43:15.499411 16316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:15.499164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:52543)
0810 06:43:15.499328 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:15.499365 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":96,"threads_started":1}
I20260810 06:43:16.299546 16317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:16.299307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:49151)
0810 06:43:16.299460 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:16.299497 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":63,"threads_started":1}
I20260810 06:43:16.371074 16318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:16.370861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:60439)
0810 06:43:16.370994 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:16.371030 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":63,"threads_started":1}
I20260810 06:43:16.500191 16319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:16.499950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:58073)
0810 06:43:16.500110 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:16.500144 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":105,"threads_started":1}
I20260810 06:43:17.300261 16320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:17.300021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:33177)
0810 06:43:17.300173 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:17.300211 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":88,"threads_started":1}
I20260810 06:43:17.371728 16321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:17.371503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:51757)
0810 06:43:17.371646 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:17.371682 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":80,"threads_started":1}
I20260810 06:43:17.500850 16322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:17.500646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:44247)
0810 06:43:17.500771 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:17.500806 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":67,"threads_started":1}
I20260810 06:43:18.301029 16324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:18.300805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.129:36335)
0810 06:43:18.300944 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:18.300981 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":66,"threads_started":1}
I20260810 06:43:18.372463 16326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:18.372245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.130:46071)
0810 06:43:18.372381 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:18.372419 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
I20260810 06:43:18.500993 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 15629
I20260810 06:43:18.506856 16327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:18.505840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:46465 (local address 127.27.41.131:56547)
0810 06:43:18.506744 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:18.506796 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:46465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":884,"thread_start_us":57,"threads_started":1}
I20260810 06:43:18.512881 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 15875
I20260810 06:43:18.523234 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 16070
2026-08-10T06:43:18Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18813 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:43:18 dist-test-slave-bw88 krb5kdc[16331](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:43:18 dist-test-slave-bw88 krb5kdc[16331](info): set up 2 sockets
Aug 10 06:43:18 dist-test-slave-bw88 krb5kdc[16331](info): commencing operation
krb5kdc: starting...
W20260810 06:43:19.724090 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:43:19 dist-test-slave-bw88 krb5kdc[16331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:43:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:43:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:43:19.842286 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:45157
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:32901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:45157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:43:19.923481 16354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:19.923717 16354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:19.923751 16354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:19.924868 16354 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 06:43:19.924930 16354 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 06:43:19.924950 16354 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 06:43:19.924968 16354 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:43:19.924991 16354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:19.925020 16354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:19.925051 16354 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:43:19.925081 16354 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:43:19.926538 16354 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:32901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:45157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:45157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:19.926808 16354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:19.927033 16354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:19.932132 16362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:19.932164 16361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:19.932159 16364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:19.932183 16354 server_base.cc:1034] running on GCE node
I20260810 06:43:19.932564 16354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:19.932884 16354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:19.934041 16354 hybrid_clock.cc:648] HybridClock initialized: now 1786344199934037 us; error 42 us; skew 500 ppm
Aug 10 06:43:19 dist-test-slave-bw88 krb5kdc[16331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344199, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:19.936514 16354 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:43:19.936930 16354 webserver.cc:460] Webserver started at http://127.27.41.190:35775/ using document root <none> and password file <none>
I20260810 06:43:19.937155 16354 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:19.937222 16354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:19.937408 16354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:43:19.938441 16354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "50da086ebf274d118017a93bc5b8c185"
format_stamp: "Formatted at 2026-08-10 06:43:19 on dist-test-slave-bw88"
server_key: "f2ef7137e19117810cbed6428d0ffe0f"
server_key_iv: "e523a7eae392cdcda2ef5538b69b1fd9"
server_key_version: "encryptionkey@0"
I20260810 06:43:19.938802 16354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "50da086ebf274d118017a93bc5b8c185"
format_stamp: "Formatted at 2026-08-10 06:43:19 on dist-test-slave-bw88"
server_key: "f2ef7137e19117810cbed6428d0ffe0f"
server_key_iv: "e523a7eae392cdcda2ef5538b69b1fd9"
server_key_version: "encryptionkey@0"
I20260810 06:43:19.940156 16354 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:43:19.940852 16374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:19.941028 16354 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:43:19.941131 16354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "50da086ebf274d118017a93bc5b8c185"
format_stamp: "Formatted at 2026-08-10 06:43:19 on dist-test-slave-bw88"
server_key: "f2ef7137e19117810cbed6428d0ffe0f"
server_key_iv: "e523a7eae392cdcda2ef5538b69b1fd9"
server_key_version: "encryptionkey@0"
I20260810 06:43:19.941219 16354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:19.954555 16354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:19.956455 16354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:19.956624 16354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:19.960950 16354 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:45157
I20260810 06:43:19.960990 16447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:45157 every 8 connection(s)
I20260810 06:43:19.961426 16354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:43:19.962280 16448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:19.964594 16448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Bootstrap starting.
I20260810 06:43:19.965215 16448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:19.965564 16448 log.cc:824] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:19.966261 16448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: No bootstrap required, opened a new log
I20260810 06:43:19.966864 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 16354
I20260810 06:43:19.966971 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:43:19.967206 27814 external_mini_cluster.cc:1428] Setting key d8c55b1dcbbb3dab2694fc68a725d425
I20260810 06:43:19.968921 16448 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } }
I20260810 06:43:19.969105 16448 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:19.969177 16448 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da086ebf274d118017a93bc5b8c185, State: Initialized, Role: FOLLOWER
I20260810 06:43:19.969314 16448 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } }
I20260810 06:43:19.969435 16448 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:43:19.969466 16448 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:43:19.969555 16448 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:19.970100 16448 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } }
I20260810 06:43:19.970220 16448 leader_election.cc:302] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50da086ebf274d118017a93bc5b8c185; no voters:
I20260810 06:43:19.970408 16448 leader_election.cc:288] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:43:19.970439 16459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:43:19.970569 16459 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 1 LEADER]: Becoming Leader. State: Replica: 50da086ebf274d118017a93bc5b8c185, State: Running, Role: LEADER
I20260810 06:43:19.970680 16448 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:43:19.970715 16459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } }
I20260810 06:43:19.971141 16462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50da086ebf274d118017a93bc5b8c185" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } } }
I20260810 06:43:19.971236 16462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: This master's current role is: LEADER
I20260810 06:43:19.971469 16463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50da086ebf274d118017a93bc5b8c185. Latest consensus state: current_term: 1 leader_uuid: "50da086ebf274d118017a93bc5b8c185" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } } }
I20260810 06:43:19.971832 16463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: This master's current role is: LEADER
W20260810 06:43:19.972599 16480 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:43:19.972654 16480 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:43:19.972702 16469 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:43:19.972860 16469 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:43:19.974368 16469 catalog_manager.cc:1347] Generated new cluster ID: ca53ada575de4d6a8491f38c9a5a57a2
I20260810 06:43:19.974423 16469 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:43:19 dist-test-slave-bw88 krb5kdc[16331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:19.978866 16458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:19.967727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33544 (local address 127.27.41.190:45157)
0810 06:43:19.967906 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:19.967917 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:19.967950 (+ 33us) server_negotiation.cc:407] Connection header received
0810 06:43:19.968848 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:19.968855 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:19.968912 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:19.969106 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:19.969996 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:19.971227 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:19.972376 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:19.972970 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:19.973075 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:19.975718 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:19.975722 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:19.975722 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:19.975734 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:19.977465 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:19.977796 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:19.977799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:19.977799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:19.977878 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:19.978075 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:19.978076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:19.978077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:19.978280 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:19.978429 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:19.978563 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 06:43:19.978696 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260810 06:43:19.986907 16469 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:43:19.987591 16469 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:43:19.995508 16469 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Generated new TSK 0
I20260810 06:43:19.995689 16469 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:43:20.026430 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:45157
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:32901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:43:20.110749 16487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:20.110967 16487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:20.111006 16487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:20.112145 16487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:20.112205 16487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:20.112250 16487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:43:20.113720 16487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:32901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:45157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:20.113960 16487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:20.114185 16487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:43:20.119253 16487 server_base.cc:1034] running on GCE node
W20260810 06:43:20.119277 16492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:20.119257 16494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:20.119270 16496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:20.119697 16487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:20.119953 16487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:20.121110 16487 hybrid_clock.cc:648] HybridClock initialized: now 1786344200121102 us; error 32 us; skew 500 ppm
Aug 10 06:43:20 dist-test-slave-bw88 krb5kdc[16331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344200, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:20.123793 16487 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:43:20.124253 16487 webserver.cc:460] Webserver started at http://127.27.41.129:33027/ using document root <none> and password file <none>
I20260810 06:43:20.124495 16487 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:20.124569 16487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:20.124706 16487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:43:20.125797 16487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "b77fae6dce3e4d70960fde49d8a3a3e9"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "8718c11396581ff68cc6a875fe122c88"
server_key_iv: "1664dbf6439595b8818180f2dae53352"
server_key_version: "encryptionkey@0"
I20260810 06:43:20.126166 16487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "b77fae6dce3e4d70960fde49d8a3a3e9"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "8718c11396581ff68cc6a875fe122c88"
server_key_iv: "1664dbf6439595b8818180f2dae53352"
server_key_version: "encryptionkey@0"
I20260810 06:43:20.127475 16487 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:20.128168 16509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:20.128334 16487 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:43:20.128420 16487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "b77fae6dce3e4d70960fde49d8a3a3e9"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "8718c11396581ff68cc6a875fe122c88"
server_key_iv: "1664dbf6439595b8818180f2dae53352"
server_key_version: "encryptionkey@0"
I20260810 06:43:20.128508 16487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:20.152082 16487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:20.154449 16487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:20.154613 16487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:20.154873 16487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:20.155233 16487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:43:20.155298 16487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:20.155341 16487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:43:20.155366 16487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:20.161239 16487 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:37213
I20260810 06:43:20.161310 16683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:37213 every 8 connection(s)
I20260810 06:43:20.161664 16487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:43:20.162283 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 16487
I20260810 06:43:20.162407 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:43:20.162678 27814 external_mini_cluster.cc:1428] Setting key ad32eb39bc7235dca6ec825fd43806a2
Aug 10 06:43:20 dist-test-slave-bw88 krb5kdc[16331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344200, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:20.173130 16458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.162460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:42589 (local address 127.27.41.190:45157)
0810 06:43:20.162509 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:20.162511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:20.162758 (+ 247us) server_negotiation.cc:407] Connection header received
0810 06:43:20.163461 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:20.163462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:20.163475 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:20.163526 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:20.164503 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.165309 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.166890 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.167110 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.167186 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.169767 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:20.169769 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:20.169770 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:20.169779 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:20.171626 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:20.172036 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:20.172037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:20.172038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:20.172100 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:20.172402 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:20.172403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:20.172404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:20.172566 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:20.172651 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:20.172900 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 06:43:20.173021 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 06:43:20.173141 16688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.162445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:42589)
0810 06:43:20.162624 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:20.162662 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:20.163343 (+ 681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:20.163605 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:20.163608 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:20.164200 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:20.164391 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.164394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.165440 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.165442 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.166797 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.166800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.167228 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.167229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.167381 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.167907 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:20.167918 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:20.169671 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:20.171718 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:20.171726 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:20.171728 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:20.171955 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:20.172173 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:20.172173 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:20.172173 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:20.172324 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:20.172640 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:20.172645 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:20.172762 (+ 117us) client_negotiation.cc:769] Sending connection context
0810 06:43:20.172847 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 06:43:20.172969 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":105,"threads_started":1}
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
I20260810 06:43:20.173681 16685 heartbeater.cc:347] Connected to a master server at 127.27.41.190:45157
I20260810 06:43:20.173794 16685 heartbeater.cc:464] Registering TS with master...
I20260810 06:43:20.173976 16685 heartbeater.cc:511] Master 127.27.41.190:45157 requested a full tablet report, sending...
I20260810 06:43:20.174523 16397 ts_manager.cc:194] Registered new tserver with Master: b77fae6dce3e4d70960fde49d8a3a3e9 (127.27.41.129:37213)
I20260810 06:43:20.175140 16397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:42589
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:43:20.192126 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:45157
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:32901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:43:20.274235 16691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:20.274469 16691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:20.274508 16691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:20.275609 16691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:20.275669 16691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:20.275713 16691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:43:20.277189 16691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:32901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:45157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:20.277436 16691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:20.277640 16691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:43:20.282939 16691 server_base.cc:1034] running on GCE node
W20260810 06:43:20.282893 16698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:20.282904 16701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:20.282889 16696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:20.283396 16691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:20.283674 16691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:20.284822 16691 hybrid_clock.cc:648] HybridClock initialized: now 1786344200284804 us; error 31 us; skew 500 ppm
Aug 10 06:43:20 dist-test-slave-bw88 krb5kdc[16331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344200, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:20.287642 16691 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:43:20.288048 16691 webserver.cc:460] Webserver started at http://127.27.41.130:39173/ using document root <none> and password file <none>
I20260810 06:43:20.288283 16691 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:20.288347 16691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:20.288489 16691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:43:20.289558 16691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "c35ef0117a064e1e9a7df7b8127b2f8a"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "ee5a9facdda346085fc82edb02716c75"
server_key_iv: "e1e213fc6a7e889a7e37c5f27b9daf45"
server_key_version: "encryptionkey@0"
I20260810 06:43:20.289923 16691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "c35ef0117a064e1e9a7df7b8127b2f8a"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "ee5a9facdda346085fc82edb02716c75"
server_key_iv: "e1e213fc6a7e889a7e37c5f27b9daf45"
server_key_version: "encryptionkey@0"
I20260810 06:43:20.291188 16691 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:20.291910 16709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:20.292078 16691 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:43:20.292165 16691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "c35ef0117a064e1e9a7df7b8127b2f8a"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "ee5a9facdda346085fc82edb02716c75"
server_key_iv: "e1e213fc6a7e889a7e37c5f27b9daf45"
server_key_version: "encryptionkey@0"
I20260810 06:43:20.292243 16691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:20.304492 16691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:20.306784 16691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:20.306931 16691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:20.307148 16691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:20.307443 16691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:43:20.307505 16691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:20.307543 16691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:43:20.307575 16691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:20.313191 16691 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:33813
I20260810 06:43:20.313241 16871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:33813 every 8 connection(s)
I20260810 06:43:20.313527 16691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:43:20.316968 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 16691
I20260810 06:43:20.317111 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:43:20.317319 27814 external_mini_cluster.cc:1428] Setting key c470b586f7896c2275e204f1285b465f
Aug 10 06:43:20 dist-test-slave-bw88 krb5kdc[16331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344200, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:20.323123 16458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.314218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:50043 (local address 127.27.41.190:45157)
0810 06:43:20.314269 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:20.314271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:20.314484 (+ 213us) server_negotiation.cc:407] Connection header received
0810 06:43:20.314942 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:20.314943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:20.314954 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:20.314996 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:20.315990 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.316478 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.317629 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.317821 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.317903 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.320147 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:20.320148 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:20.320149 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:20.320157 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:20.321568 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:20.322057 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:20.322058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:20.322058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:20.322118 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:20.322436 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:20.322436 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:20.322437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:20.322534 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:20.322585 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:20.322987 (+ 402us) server_negotiation.cc:299] Negotiation successful
0810 06:43:20.323052 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:43:20.323347 16874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.314196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:50043)
0810 06:43:20.314372 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:20.314406 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:20.314852 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:20.315046 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:20.315049 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:20.315686 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:20.315915 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.315921 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.316553 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.316554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.317530 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.317532 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.317916 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.317917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.318043 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.318500 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:20.318508 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:20.320059 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:20.321646 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:20.321654 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:20.321656 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:20.321975 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:20.322181 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:20.322182 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:20.322182 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:20.322352 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:20.322630 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:20.322656 (+ 26us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:20.322830 (+ 174us) client_negotiation.cc:769] Sending connection context
0810 06:43:20.322949 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 06:43:20.323123 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
I20260810 06:43:20.323813 16872 heartbeater.cc:347] Connected to a master server at 127.27.41.190:45157
I20260810 06:43:20.323901 16872 heartbeater.cc:464] Registering TS with master...
I20260810 06:43:20.324083 16872 heartbeater.cc:511] Master 127.27.41.190:45157 requested a full tablet report, sending...
I20260810 06:43:20.324486 16397 ts_manager.cc:194] Registered new tserver with Master: c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813)
I20260810 06:43:20.325001 16397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:50043
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:43:20.343856 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:45157
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:32901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:43:20.425223 16878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:20.425469 16878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:20.425498 16878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:20.426666 16878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:20.426705 16878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:20.426752 16878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:43:20.428138 16878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:32901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:45157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:20.428359 16878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:20.428577 16878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:20.433653 16884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:20.433919 16878 server_base.cc:1034] running on GCE node
W20260810 06:43:20.433645 16889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:20.433645 16885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:20.434207 16878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:20.434464 16878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:20.435621 16878 hybrid_clock.cc:648] HybridClock initialized: now 1786344200435601 us; error 34 us; skew 500 ppm
Aug 10 06:43:20 dist-test-slave-bw88 krb5kdc[16331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344200, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:20.438061 16878 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:43:20.438513 16878 webserver.cc:460] Webserver started at http://127.27.41.131:43777/ using document root <none> and password file <none>
I20260810 06:43:20.438732 16878 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:20.438776 16878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:20.438920 16878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:43:20.439945 16878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "f8fcce10b7104179a6be17c3a4159b31"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "9f34da69a5393cdb0e886a4295174660"
server_key_iv: "73d567e90bcf246fdc23ee6bd336f476"
server_key_version: "encryptionkey@0"
I20260810 06:43:20.440321 16878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "f8fcce10b7104179a6be17c3a4159b31"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "9f34da69a5393cdb0e886a4295174660"
server_key_iv: "73d567e90bcf246fdc23ee6bd336f476"
server_key_version: "encryptionkey@0"
I20260810 06:43:20.441697 16878 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:43:20.442438 16898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:20.442619 16878 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:43:20.442706 16878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "f8fcce10b7104179a6be17c3a4159b31"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "9f34da69a5393cdb0e886a4295174660"
server_key_iv: "73d567e90bcf246fdc23ee6bd336f476"
server_key_version: "encryptionkey@0"
I20260810 06:43:20.442760 16878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:20.466138 16878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:20.468415 16878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:20.468546 16878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:20.468742 16878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:20.469062 16878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:43:20.469097 16878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:20.469137 16878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:43:20.469165 16878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:20.475492 16878 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:46271
I20260810 06:43:20.475564 17067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:46271 every 8 connection(s)
I20260810 06:43:20.475883 16878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:43:20.479103 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 16878
I20260810 06:43:20.479223 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:43:20.479413 27814 external_mini_cluster.cc:1428] Setting key b51ef0438f1316f124a24068bf3d6c4a
Aug 10 06:43:20 dist-test-slave-bw88 krb5kdc[16331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344200, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:20.484948 16458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.476617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:60917 (local address 127.27.41.190:45157)
0810 06:43:20.476672 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:20.476674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:20.476890 (+ 216us) server_negotiation.cc:407] Connection header received
0810 06:43:20.477423 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:20.477424 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:20.477435 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:20.477484 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:20.478376 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.478876 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.480281 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.480473 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.480528 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.482605 (+ 2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:20.482607 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:20.482607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:20.482614 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:20.483787 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:20.484153 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:20.484154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:20.484154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:20.484204 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:20.484410 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:20.484410 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:20.484410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:20.484539 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:20.484596 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:20.484825 (+ 229us) server_negotiation.cc:299] Negotiation successful
0810 06:43:20.484887 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 06:43:20.485183 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.476606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:60917)
0810 06:43:20.476768 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:20.476804 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:20.477283 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:20.477549 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:20.477553 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:20.478116 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:20.478306 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.478311 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.478975 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.478976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.480143 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.480146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.480542 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.480543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.480645 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.481053 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:20.481061 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:20.482521 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:20.483856 (+ 1335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:20.483863 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:20.483865 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:20.484080 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:20.484260 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:20.484261 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:20.484261 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:20.484359 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:20.484599 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:20.484603 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:20.484711 (+ 108us) client_negotiation.cc:769] Sending connection context
0810 06:43:20.484802 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 06:43:20.484918 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260810 06:43:20.485745 17068 heartbeater.cc:347] Connected to a master server at 127.27.41.190:45157
I20260810 06:43:20.485849 17068 heartbeater.cc:464] Registering TS with master...
I20260810 06:43:20.486027 17068 heartbeater.cc:511] Master 127.27.41.190:45157 requested a full tablet report, sending...
I20260810 06:43:20.486444 16397 ts_manager.cc:194] Registered new tserver with Master: f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271)
I20260810 06:43:20.486815 16397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:60917
I20260810 06:43:20.491024 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:43:20.498345 16458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.492355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33548 (local address 127.27.41.190:45157)
0810 06:43:20.492411 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:20.492413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:20.492558 (+ 145us) server_negotiation.cc:407] Connection header received
0810 06:43:20.492603 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:20.492603 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:20.492611 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:20.492662 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:20.493202 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.493719 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.494412 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.494587 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.494633 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.496002 (+ 1369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:20.496004 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:20.496004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:20.496010 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:20.497432 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:20.497730 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:20.497730 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:20.497731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:20.497784 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:20.497933 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:20.497933 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:20.497933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:20.498069 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:20.498141 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:20.498223 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 06:43:20.498284 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 06:43:20.499984 16397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33548:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:43:20.501627 16397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:43:20.508256 17089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.503836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:33813 (local address 127.0.0.1:40112)
0810 06:43:20.504038 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:20.504080 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:20.504145 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:20.504606 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:20.504607 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:20.504609 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:20.504668 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.504670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.505979 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.505980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.507099 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.507102 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.507956 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.507957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.508032 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.508046 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 06:43:20.508118 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 06:43:20.508176 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":85,"thread_start_us":86,"threads_started":1}
I20260810 06:43:20.508288 17091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.503966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40112 (local address 127.27.41.130:33813)
0810 06:43:20.504409 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:20.504414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:20.504424 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:43:20.504469 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:20.504471 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:20.504489 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:20.504754 (+ 265us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:20.504841 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.505814 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.507200 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.507865 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.507943 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.507999 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:20.508147 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 06:43:20.508197 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":93,"threads_started":1}
I20260810 06:43:20.508450 17098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.504197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45642 (local address 127.27.41.129:37213)
0810 06:43:20.504663 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:20.504667 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:20.504677 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:43:20.504716 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:20.504719 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:20.504734 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:20.504800 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:20.504927 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.505992 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.507447 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.507899 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.507994 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.508053 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:20.508300 (+ 247us) server_negotiation.cc:299] Negotiation successful
0810 06:43:20.508347 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":82,"threads_started":1}
I20260810 06:43:20.508718 17084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.504073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:37213 (local address 127.0.0.1:45642)
0810 06:43:20.504367 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:20.504380 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:20.504440 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:20.504796 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:20.504797 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:20.504798 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:20.504840 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.504841 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.506103 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.506104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.507346 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.507349 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.508085 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.508086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.508140 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.508143 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:43:20.508187 (+ 44us) client_negotiation.cc:240] Negotiation successful
0810 06:43:20.508218 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":32,"thread_start_us":82,"threads_started":1}
I20260810 06:43:20.508754 17097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.504182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59370 (local address 127.27.41.131:46271)
0810 06:43:20.504355 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:20.504360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:20.504374 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:43:20.504404 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:20.504406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:20.504418 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:20.504502 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:20.504681 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.505818 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.507429 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.508091 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.508175 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.508225 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:20.508602 (+ 377us) server_negotiation.cc:299] Negotiation successful
0810 06:43:20.508650 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":95,"threads_started":1}
I20260810 06:43:20.508852 17095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.503885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:46271 (local address 127.0.0.1:59370)
0810 06:43:20.504204 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:20.504214 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:20.504252 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:20.504517 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:20.504521 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:20.504523 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:20.504593 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.504594 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.505945 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.505946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.507348 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.507349 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.508261 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.508261 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.508339 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.508344 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:43:20.508398 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 06:43:20.508438 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":7,"thread_start_us":98,"threads_started":1}
I20260810 06:43:20.509475 16783 tablet_service.cc:1467] Processing CreateTablet for tablet 91bd84f8987c4b5f8cd9889039ad0cfb (DEFAULT_TABLE table=test-table [id=f0480c2d076f4ec99c8c405ca0b8702c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:43:20.509665 16973 tablet_service.cc:1467] Processing CreateTablet for tablet 91bd84f8987c4b5f8cd9889039ad0cfb (DEFAULT_TABLE table=test-table [id=f0480c2d076f4ec99c8c405ca0b8702c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:43:20.509874 16783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91bd84f8987c4b5f8cd9889039ad0cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:20.509918 16973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91bd84f8987c4b5f8cd9889039ad0cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:20.509838 16585 tablet_service.cc:1467] Processing CreateTablet for tablet 91bd84f8987c4b5f8cd9889039ad0cfb (DEFAULT_TABLE table=test-table [id=f0480c2d076f4ec99c8c405ca0b8702c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:43:20.510174 16585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91bd84f8987c4b5f8cd9889039ad0cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:20.512693 17099 tablet_bootstrap.cc:492] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31: Bootstrap starting.
I20260810 06:43:20.513499 17099 tablet_bootstrap.cc:654] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:20.513487 17101 tablet_bootstrap.cc:492] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a: Bootstrap starting.
I20260810 06:43:20.514106 17099 log.cc:824] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:20.514211 17101 tablet_bootstrap.cc:654] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:20.514539 17100 tablet_bootstrap.cc:492] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Bootstrap starting.
I20260810 06:43:20.514813 17101 log.cc:824] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:20.514894 17099 tablet_bootstrap.cc:492] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31: No bootstrap required, opened a new log
I20260810 06:43:20.514990 17099 ts_tablet_manager.cc:1397] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 06:43:20.515479 17100 tablet_bootstrap.cc:654] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:20.515661 17101 tablet_bootstrap.cc:492] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a: No bootstrap required, opened a new log
I20260810 06:43:20.515733 17101 ts_tablet_manager.cc:1397] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 06:43:20.516079 17100 log.cc:824] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:20.516789 17100 tablet_bootstrap.cc:492] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: No bootstrap required, opened a new log
I20260810 06:43:20.516866 17100 ts_tablet_manager.cc:1397] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:43:20.517168 17099 raft_consensus.cc:348] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } }
I20260810 06:43:20.517370 17099 raft_consensus.cc:374] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:20.517446 17099 raft_consensus.cc:729] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8fcce10b7104179a6be17c3a4159b31, State: Initialized, Role: FOLLOWER
I20260810 06:43:20.517596 17099 consensus_queue.cc:260] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } }
I20260810 06:43:20.517884 17099 ts_tablet_manager.cc:1428] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 06:43:20.517833 17101 raft_consensus.cc:348] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } }
I20260810 06:43:20.518004 17068 heartbeater.cc:503] Master 127.27.41.190:45157 was elected leader, sending a full tablet report...
I20260810 06:43:20.518005 17101 raft_consensus.cc:374] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:20.518045 17101 raft_consensus.cc:729] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c35ef0117a064e1e9a7df7b8127b2f8a, State: Initialized, Role: FOLLOWER
I20260810 06:43:20.518162 17101 consensus_queue.cc:260] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } }
I20260810 06:43:20.518446 16872 heartbeater.cc:503] Master 127.27.41.190:45157 was elected leader, sending a full tablet report...
I20260810 06:43:20.518687 17101 ts_tablet_manager.cc:1428] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:43:20.518750 17100 raft_consensus.cc:348] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } }
I20260810 06:43:20.518910 17100 raft_consensus.cc:374] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:20.519002 17100 raft_consensus.cc:729] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77fae6dce3e4d70960fde49d8a3a3e9, State: Initialized, Role: FOLLOWER
I20260810 06:43:20.519142 17100 consensus_queue.cc:260] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } }
I20260810 06:43:20.519443 17100 ts_tablet_manager.cc:1428] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:43:20.519625 16685 heartbeater.cc:503] Master 127.27.41.190:45157 was elected leader, sending a full tablet report...
W20260810 06:43:20.564163 16873 tablet.cc:2369] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:43:20.662539 16687 tablet.cc:2369] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:43:20.726475 17070 tablet.cc:2369] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:43:20.764279 17109 raft_consensus.cc:482] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:43:20.764436 17109 raft_consensus.cc:504] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } }
I20260810 06:43:20.764869 17109 leader_election.cc:288] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813), f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271)
I20260810 06:43:20.768105 17091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.765210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:34297 (local address 127.27.41.130:33813)
0810 06:43:20.765268 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:20.765270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:20.765396 (+ 126us) server_negotiation.cc:407] Connection header received
0810 06:43:20.765508 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:20.765510 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:20.765520 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:20.765578 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:20.765786 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.766277 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.767357 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.767725 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.767783 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.767790 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:20.767974 (+ 184us) server_negotiation.cc:299] Negotiation successful
0810 06:43:20.768018 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 06:43:20.768115 17097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.765258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:58925 (local address 127.27.41.131:46271)
0810 06:43:20.765305 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:20.765306 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:20.765471 (+ 165us) server_negotiation.cc:407] Connection header received
0810 06:43:20.765527 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:20.765528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:20.765538 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:20.765625 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:20.765819 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.766289 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.767328 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.767747 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.767843 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.767851 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:20.768010 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 06:43:20.768052 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 06:43:20.768123 17110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.765133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:33813 (local address 127.27.41.129:34297)
0810 06:43:20.765300 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:20.765318 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:20.765406 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:20.765602 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:20.765603 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:20.765606 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:20.765708 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.765711 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.766362 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.766363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.767236 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.767238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.767807 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.767808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.767884 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.767901 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 06:43:20.767950 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 06:43:20.768011 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":32,"thread_start_us":80,"threads_started":1}
I20260810 06:43:20.768127 17111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.765135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:46271 (local address 127.27.41.129:58925)
0810 06:43:20.765326 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:20.765357 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:20.765443 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:20.765632 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:20.765632 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:20.765634 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:20.765721 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.765723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.766397 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.766398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.767232 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:20.767234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.767856 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.767857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:20.767917 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.767921 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:43:20.767991 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 06:43:20.768028 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":24,"spinlock_wait_cycles":14592,"thread_start_us":113,"threads_started":1}
I20260810 06:43:20.768533 16807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bd84f8987c4b5f8cd9889039ad0cfb" candidate_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" is_pre_election: true
I20260810 06:43:20.768744 16807 raft_consensus.cc:2454] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77fae6dce3e4d70960fde49d8a3a3e9 in term 0.
I20260810 06:43:20.768795 17000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bd84f8987c4b5f8cd9889039ad0cfb" candidate_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8fcce10b7104179a6be17c3a4159b31" is_pre_election: true
I20260810 06:43:20.768963 17000 raft_consensus.cc:2454] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b77fae6dce3e4d70960fde49d8a3a3e9 in term 0.
I20260810 06:43:20.769008 16516 leader_election.cc:302] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77fae6dce3e4d70960fde49d8a3a3e9, c35ef0117a064e1e9a7df7b8127b2f8a; no voters:
I20260810 06:43:20.769146 17109 raft_consensus.cc:2781] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:43:20.769233 17109 raft_consensus.cc:482] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:43:20.769266 17109 raft_consensus.cc:3037] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:20.769999 17109 raft_consensus.cc:504] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } }
I20260810 06:43:20.770175 17109 leader_election.cc:288] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 1 election: Requested vote from peers c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813), f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271)
I20260810 06:43:20.770354 16807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bd84f8987c4b5f8cd9889039ad0cfb" candidate_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a"
I20260810 06:43:20.770423 16807 raft_consensus.cc:3037] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:20.770371 17000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bd84f8987c4b5f8cd9889039ad0cfb" candidate_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8fcce10b7104179a6be17c3a4159b31"
I20260810 06:43:20.770475 17000 raft_consensus.cc:3037] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:20.771126 16807 raft_consensus.cc:2454] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77fae6dce3e4d70960fde49d8a3a3e9 in term 1.
I20260810 06:43:20.771317 16516 leader_election.cc:302] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77fae6dce3e4d70960fde49d8a3a3e9, c35ef0117a064e1e9a7df7b8127b2f8a; no voters:
I20260810 06:43:20.771366 17000 raft_consensus.cc:2454] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b77fae6dce3e4d70960fde49d8a3a3e9 in term 1.
I20260810 06:43:20.771427 17109 raft_consensus.cc:2781] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:43:20.771658 17109 raft_consensus.cc:686] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 LEADER]: Becoming Leader. State: Replica: b77fae6dce3e4d70960fde49d8a3a3e9, State: Running, Role: LEADER
I20260810 06:43:20.771785 17109 consensus_queue.cc:237] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } }
I20260810 06:43:20.772589 16397 catalog_manager.cc:5495] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b77fae6dce3e4d70960fde49d8a3a3e9 (127.27.41.129). New cstate: current_term: 1 leader_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260810 06:43:20.789542 17098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.787323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45654 (local address 127.27.41.129:37213)
0810 06:43:20.787380 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:20.787381 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:20.787392 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:43:20.787463 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:20.787464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:20.787480 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:20.787534 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:43:20.787623 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.788096 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.788836 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:20.789006 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:20.789054 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:20.789188 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:43:20.789296 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:43:20.789409 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:20.789441 (+ 32us) server_negotiation.cc:299] Negotiation successful
0810 06:43:20.789459 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 06:43:20.791291 17000 raft_consensus.cc:1261] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31 [term 1 FOLLOWER]: Refusing update from remote peer b77fae6dce3e4d70960fde49d8a3a3e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:43:20.791290 16807 raft_consensus.cc:1261] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a [term 1 FOLLOWER]: Refusing update from remote peer b77fae6dce3e4d70960fde49d8a3a3e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:43:20.791630 17109 consensus_queue.cc:1035] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:43:20.791800 17112 consensus_queue.cc:1035] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:43:20.794042 17116 mvcc.cc:205] Tried to move back new op lower bound from 7316865846438514688 to 7316865846361837568. Current Snapshot: MvccSnapshot[applied={T|T < 7316865846438514688}]
I20260810 06:43:20.794495 17119 mvcc.cc:205] Tried to move back new op lower bound from 7316865846438514688 to 7316865846361837568. Current Snapshot: MvccSnapshot[applied={T|T < 7316865846438514688}]
I20260810 06:43:20.794625 17117 mvcc.cc:205] Tried to move back new op lower bound from 7316865846438514688 to 7316865846361837568. Current Snapshot: MvccSnapshot[applied={T|T < 7316865846438514688}]
I20260810 06:43:20.796716 16395 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:43:20.796814 16395 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:43:20.797573 16395 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Sending DeleteTablet for 3 replicas of tablet 91bd84f8987c4b5f8cd9889039ad0cfb
I20260810 06:43:20.797909 16783 tablet_service.cc:1514] Processing DeleteTablet for tablet 91bd84f8987c4b5f8cd9889039ad0cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:20 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:40112
I20260810 06:43:20.797914 16973 tablet_service.cc:1514] Processing DeleteTablet for tablet 91bd84f8987c4b5f8cd9889039ad0cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:20 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:59370
I20260810 06:43:20.798185 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 16487
I20260810 06:43:20.798175 16585 tablet_service.cc:1514] Processing DeleteTablet for tablet 91bd84f8987c4b5f8cd9889039ad0cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:20 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:45642
I20260810 06:43:20.803663 17135 tablet_replica.cc:330] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a: stopping tablet replica
I20260810 06:43:20.803814 17135 raft_consensus.cc:2229] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:43:20.803973 17135 raft_consensus.cc:2258] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:43:20.804239 17132 tablet_replica.cc:330] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31: stopping tablet replica
I20260810 06:43:20.804365 17132 raft_consensus.cc:2229] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:43:20.804468 17132 raft_consensus.cc:2258] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:43:20.804770 17135 ts_tablet_manager.cc:1905] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:43:20.806237 17132 ts_tablet_manager.cc:1905] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:43:20.806509 17135 ts_tablet_manager.cc:1918] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:43:20.806591 17135 log.cc:1196] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/91bd84f8987c4b5f8cd9889039ad0cfb
I20260810 06:43:20.806854 17135 ts_tablet_manager.cc:1939] T 91bd84f8987c4b5f8cd9889039ad0cfb P c35ef0117a064e1e9a7df7b8127b2f8a: Deleting consensus metadata
I20260810 06:43:20.807318 16381 catalog_manager.cc:4841] TS c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813): tablet 91bd84f8987c4b5f8cd9889039ad0cfb (table test-table [id=f0480c2d076f4ec99c8c405ca0b8702c]) successfully deleted
I20260810 06:43:20.807861 17132 ts_tablet_manager.cc:1918] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:43:20.807943 17132 log.cc:1196] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/91bd84f8987c4b5f8cd9889039ad0cfb
I20260810 06:43:20.808240 17132 ts_tablet_manager.cc:1939] T 91bd84f8987c4b5f8cd9889039ad0cfb P f8fcce10b7104179a6be17c3a4159b31: Deleting consensus metadata
I20260810 06:43:20.808615 16377 catalog_manager.cc:4841] TS f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271): tablet 91bd84f8987c4b5f8cd9889039ad0cfb (table test-table [id=f0480c2d076f4ec99c8c405ca0b8702c]) successfully deleted
W20260810 06:43:20.811295 16381 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:37213 (error 108)
I20260810 06:43:20.811528 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 16691
I20260810 06:43:20.811827 17095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:20.811712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:37213 (local address 127.0.0.1:45656)
0810 06:43:20.811761 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:20.811789 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:37213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 06:43:20.811931 16381 catalog_manager.cc:4584] TS b77fae6dce3e4d70960fde49d8a3a3e9 (127.27.41.129:37213): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 91bd84f8987c4b5f8cd9889039ad0cfb: Network error: Client connection negotiation failed: client connection to 127.27.41.129:37213: connect: Connection refused (error 111)
I20260810 06:43:20.820428 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 16878
I20260810 06:43:20.831759 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 16354
I20260810 06:43:40.843179 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:45157
--webserver_interface=127.27.41.190
--webserver_port=35775
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:32901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:45157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:43:40.926452 17137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:40.926653 17137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:40.926674 17137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:40.927747 17137 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 06:43:40.927781 17137 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 06:43:40.927795 17137 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 06:43:40.927806 17137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:43:40.927819 17137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:40.927832 17137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:40.927850 17137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:43:40.927863 17137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:43:40.929327 17137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:32901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:45157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:45157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=35775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:40.929544 17137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:40.929704 17137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:40.939297 17144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:40.939529 17137 server_base.cc:1034] running on GCE node
W20260810 06:43:40.939325 17149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:40.939325 17145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:40.939864 17137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:40.940182 17137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:40.941373 17137 hybrid_clock.cc:648] HybridClock initialized: now 1786344220941325 us; error 30 us; skew 500 ppm
Aug 10 06:43:40 dist-test-slave-bw88 krb5kdc[16331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344220, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:40.947589 17137 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:43:40.948074 17137 webserver.cc:460] Webserver started at http://127.27.41.190:35775/ using document root <none> and password file <none>
I20260810 06:43:40.948297 17137 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:40.948354 17137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:40.949860 17137 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:43:40.950538 17159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:40.950736 17137 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:40.950839 17137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "50da086ebf274d118017a93bc5b8c185"
format_stamp: "Formatted at 2026-08-10 06:43:19 on dist-test-slave-bw88"
server_key: "f2ef7137e19117810cbed6428d0ffe0f"
server_key_iv: "e523a7eae392cdcda2ef5538b69b1fd9"
server_key_version: "encryptionkey@0"
I20260810 06:43:40.951262 17137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:40.962422 17137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:40.964766 17137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:40.964876 17137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:40.969204 17137 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:45157
I20260810 06:43:40.969260 17237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:45157 every 8 connection(s)
I20260810 06:43:40.969693 17137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:43:40.971194 17239 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:43:40.971813 17239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Bootstrap starting.
I20260810 06:43:40.979748 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 17137
I20260810 06:43:40.980080 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:37213
--local_ip_for_outbound_sockets=127.27.41.129
--tserver_master_addrs=127.27.41.190:45157
--webserver_port=33027
--webserver_interface=127.27.41.129
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:32901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:43:40.981464 17239 log.cc:824] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:40.984220 17239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:43:40.984551 17239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Bootstrap complete.
I20260810 06:43:40.988783 17239 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } }
I20260810 06:43:40.989185 17239 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da086ebf274d118017a93bc5b8c185, State: Initialized, Role: FOLLOWER
I20260810 06:43:40.989413 17239 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } }
I20260810 06:43:40.989516 17239 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:43:40.989580 17239 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:43:40.989646 17239 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 1 FOLLOWER]: Advancing to term 2
I20260810 06:43:40.991277 17239 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } }
I20260810 06:43:40.991429 17239 leader_election.cc:302] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50da086ebf274d118017a93bc5b8c185; no voters:
I20260810 06:43:40.991626 17239 leader_election.cc:288] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 06:43:40.991698 17245 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 06:43:40.991874 17245 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 2 LEADER]: Becoming Leader. State: Replica: 50da086ebf274d118017a93bc5b8c185, State: Running, Role: LEADER
I20260810 06:43:40.991927 17239 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:43:40.992025 17245 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } }
I20260810 06:43:40.992420 17246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "50da086ebf274d118017a93bc5b8c185" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } } }
I20260810 06:43:40.992426 17247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50da086ebf274d118017a93bc5b8c185. Latest consensus state: current_term: 2 leader_uuid: "50da086ebf274d118017a93bc5b8c185" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } } }
I20260810 06:43:40.992537 17246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: This master's current role is: LEADER
I20260810 06:43:40.992540 17247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: This master's current role is: LEADER
I20260810 06:43:40.993017 17252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:43:40.993925 17252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:43:40.994047 17252 catalog_manager.cc:1259] Loaded cluster ID: ca53ada575de4d6a8491f38c9a5a57a2
I20260810 06:43:40.994136 17252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:43:40.995376 17252 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:43:40.995558 17252 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Loaded TSK: 0
I20260810 06:43:41.016562 17252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Generated new TSK 1
I20260810 06:43:41.016669 17252 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 06:43:41.068567 17244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:41.068801 17244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:41.068841 17244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:41.070034 17244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:41.070106 17244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:41.070151 17244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:43:41.071578 17244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:32901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:37213
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=33027
--tserver_master_addrs=127.27.41.190:45157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:41.071835 17244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:41.072057 17244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:41.077970 17273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:41.077988 17275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:41.077977 17281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:41.078229 17244 server_base.cc:1034] running on GCE node
I20260810 06:43:41.078440 17244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:41.078696 17244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:41.079861 17244 hybrid_clock.cc:648] HybridClock initialized: now 1786344221079847 us; error 33 us; skew 500 ppm
Aug 10 06:43:41 dist-test-slave-bw88 krb5kdc[16331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344221, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:41.082628 17244 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:43:41.083148 17244 webserver.cc:460] Webserver started at http://127.27.41.129:33027/ using document root <none> and password file <none>
I20260810 06:43:41.083390 17244 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:41.083447 17244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:41.084923 17244 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:41.085970 17289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:41.086197 17244 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 06:43:41.086333 17244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "b77fae6dce3e4d70960fde49d8a3a3e9"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "8718c11396581ff68cc6a875fe122c88"
server_key_iv: "1664dbf6439595b8818180f2dae53352"
server_key_version: "encryptionkey@0"
I20260810 06:43:41.086802 17244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:41.103895 17244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:41.106204 17244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:41.106350 17244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:41.106634 17244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:41.107134 17303 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 06:43:41.108668 17244 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 06:43:41.108726 17244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 06:43:41.108749 17244 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 06:43:41.109493 17244 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 06:43:41.109540 17244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:41.109663 17303 tablet_bootstrap.cc:492] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Bootstrap starting.
I20260810 06:43:41.117545 17244 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:37213
I20260810 06:43:41.117619 17462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:37213 every 8 connection(s)
I20260810 06:43:41.118166 17244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:43:41.119853 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 17244
I20260810 06:43:41.120164 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:33813
--local_ip_for_outbound_sockets=127.27.41.130
--tserver_master_addrs=127.27.41.190:45157
--webserver_port=39173
--webserver_interface=127.27.41.130
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:32901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:43:41.122260 17303 log.cc:824] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:41.124914 17303 tablet_bootstrap.cc:492] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:43:41.125296 17303 tablet_bootstrap.cc:492] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Bootstrap complete.
I20260810 06:43:41.126715 17303 ts_tablet_manager.cc:1397] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.015s
I20260810 06:43:41.128134 17303 raft_consensus.cc:348] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } }
I20260810 06:43:41.128557 17303 raft_consensus.cc:729] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77fae6dce3e4d70960fde49d8a3a3e9, State: Initialized, Role: FOLLOWER
I20260810 06:43:41.128800 17303 consensus_queue.cc:260] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } }
I20260810 06:43:41.129158 17303 ts_tablet_manager.cc:1428] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Aug 10 06:43:41 dist-test-slave-bw88 krb5kdc[16331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344221, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:41.136168 17470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.118868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:41127)
0810 06:43:41.122649 (+ 3781us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:41.122684 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:41.123206 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:41.123823 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:41.123828 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:41.124251 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:41.124577 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.124585 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.126337 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.126338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.127776 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.127780 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.128863 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.128863 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.129015 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.129676 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:41.129688 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:41.131649 (+ 1961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:41.134301 (+ 2652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:41.134307 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:41.134309 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:41.134598 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:41.134913 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:41.134914 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:41.134914 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:41.135046 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:41.135551 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:41.135558 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:41.135704 (+ 146us) client_negotiation.cc:769] Sending connection context
0810 06:43:41.135809 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 06:43:41.135964 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3743,"thread_start_us":426,"threads_started":1}
I20260810 06:43:41.136435 17468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.118973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:41127 (local address 127.27.41.190:45157)
0810 06:43:41.122560 (+ 3587us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:41.122576 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:41.122805 (+ 229us) server_negotiation.cc:407] Connection header received
0810 06:43:41.123451 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:41.123459 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:41.123530 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:41.123668 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:41.124739 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.126207 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.127891 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.128609 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.128721 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.131791 (+ 3070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:41.131796 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:41.131796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:41.131810 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:41.134206 (+ 2396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:41.134694 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:41.134698 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:41.134699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:41.134830 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:41.135122 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:41.135123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:41.135124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:41.135454 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:41.135565 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:41.135904 (+ 339us) server_negotiation.cc:299] Negotiation successful
0810 06:43:41.136059 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3534,"thread_start_us":112,"threads_started":1}
I20260810 06:43:41.137295 17465 heartbeater.cc:347] Connected to a master server at 127.27.41.190:45157
I20260810 06:43:41.137410 17465 heartbeater.cc:464] Registering TS with master...
I20260810 06:43:41.137588 17465 heartbeater.cc:511] Master 127.27.41.190:45157 requested a full tablet report, sending...
I20260810 06:43:41.138439 17180 ts_manager.cc:194] Registered new tserver with Master: b77fae6dce3e4d70960fde49d8a3a3e9 (127.27.41.129:37213)
I20260810 06:43:41.139748 17180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:41127
I20260810 06:43:41.140677 17465 heartbeater.cc:503] Master 127.27.41.190:45157 was elected leader, sending a full tablet report...
I20260810 06:43:41.144831 17478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.139411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35298 (local address 127.27.41.129:37213)
0810 06:43:41.141491 (+ 2080us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:41.141495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:41.141506 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:43:41.141541 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:41.141543 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:41.141558 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:41.141644 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:41.141822 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.142472 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.144056 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.144493 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.144556 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.144590 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:41.144756 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 06:43:41.144785 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2047,"thread_start_us":73,"threads_started":1}
I20260810 06:43:41.144858 17477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.139168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:37213 (local address 127.0.0.1:35298)
0810 06:43:41.140046 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:41.140085 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:41.140147 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:41.141664 (+ 1517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:41.141668 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:41.141670 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:41.141733 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.141735 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.142555 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.142557 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.143967 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.143970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.144573 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.144574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.144654 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.144668 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 06:43:41.144736 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 06:43:41.144787 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":852,"thread_start_us":90,"threads_started":1}
I20260810 06:43:41.145256 17339 tablet_service.cc:1514] Processing DeleteTablet for tablet 91bd84f8987c4b5f8cd9889039ad0cfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:20 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:35298
I20260810 06:43:41.145889 17479 tablet_replica.cc:330] stopping tablet replica
I20260810 06:43:41.146000 17479 raft_consensus.cc:2229] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:43:41.146086 17479 raft_consensus.cc:2258] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:43:41.146399 17479 ts_tablet_manager.cc:1905] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:43:41.148567 17479 ts_tablet_manager.cc:1918] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:43:41.148633 17479 log.cc:1196] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal/wals/91bd84f8987c4b5f8cd9889039ad0cfb
I20260810 06:43:41.148870 17479 ts_tablet_manager.cc:1939] T 91bd84f8987c4b5f8cd9889039ad0cfb P b77fae6dce3e4d70960fde49d8a3a3e9: Deleting consensus metadata
I20260810 06:43:41.149387 17164 catalog_manager.cc:4841] TS b77fae6dce3e4d70960fde49d8a3a3e9 (127.27.41.129:37213): tablet 91bd84f8987c4b5f8cd9889039ad0cfb (table test-table [id=f0480c2d076f4ec99c8c405ca0b8702c]) successfully deleted
W20260810 06:43:41.239167 17471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:41.239440 17471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:41.239480 17471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:41.241547 17471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:41.241631 17471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:41.241688 17471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:43:41.245316 17471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:32901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:33813
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=39173
--tserver_master_addrs=127.27.41.190:45157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:41.245594 17471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:41.245860 17471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:41.253379 17488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:41.253571 17471 server_base.cc:1034] running on GCE node
W20260810 06:43:41.253702 17490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:41.253875 17485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:41.254112 17471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:41.254423 17471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:41.255616 17471 hybrid_clock.cc:648] HybridClock initialized: now 1786344221255586 us; error 44 us; skew 500 ppm
Aug 10 06:43:41 dist-test-slave-bw88 krb5kdc[16331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344221, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:41.258759 17471 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:43:41.259364 17471 webserver.cc:460] Webserver started at http://127.27.41.130:39173/ using document root <none> and password file <none>
I20260810 06:43:41.259651 17471 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:41.259730 17471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:41.261216 17471 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 06:43:41.261920 17499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:41.262104 17471 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 06:43:41.262223 17471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "c35ef0117a064e1e9a7df7b8127b2f8a"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "ee5a9facdda346085fc82edb02716c75"
server_key_iv: "e1e213fc6a7e889a7e37c5f27b9daf45"
server_key_version: "encryptionkey@0"
I20260810 06:43:41.262604 17471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:41.291221 17471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:41.293735 17471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:41.293919 17471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:41.294200 17471 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:41.294523 17471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:43:41.294577 17471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:41.294620 17471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:43:41.294643 17471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:41.300542 17471 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:33813
I20260810 06:43:41.300587 17655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:33813 every 8 connection(s)
I20260810 06:43:41.300956 17471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:43:41.301360 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 17471
I20260810 06:43:41.301668 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:46271
--local_ip_for_outbound_sockets=127.27.41.131
--tserver_master_addrs=127.27.41.190:45157
--webserver_port=43777
--webserver_interface=127.27.41.131
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:32901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:43:41 dist-test-slave-bw88 krb5kdc[16331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344221, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:41.311578 17468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.301782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:52965 (local address 127.27.41.190:45157)
0810 06:43:41.301858 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:41.301860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:41.302040 (+ 180us) server_negotiation.cc:407] Connection header received
0810 06:43:41.302530 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:41.302532 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:41.302549 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:41.302622 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:41.303747 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.304249 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.305460 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.305831 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.305944 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.308478 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:41.308479 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:41.308480 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:41.308486 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:41.310046 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:41.310602 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:41.310603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:41.310603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:41.310654 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:41.310947 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:41.310947 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:41.310947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:41.311044 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:41.311090 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:41.311434 (+ 344us) server_negotiation.cc:299] Negotiation successful
0810 06:43:41.311506 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 06:43:41.311931 17659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.301740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:52965)
0810 06:43:41.301903 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:41.301945 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:41.302435 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:41.302701 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:41.302704 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:41.303321 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:41.303643 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.303650 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.304345 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.304346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.305291 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.305294 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.305947 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.305948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.306077 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.306594 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:41.306603 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:41.308380 (+ 1777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:41.310146 (+ 1766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:41.310155 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:41.310157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:41.310521 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:41.310722 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:41.310723 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:41.310724 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:41.310874 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:41.311107 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:41.311114 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:41.311289 (+ 175us) client_negotiation.cc:769] Sending connection context
0810 06:43:41.311417 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 06:43:41.311615 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260810 06:43:41.312528 17656 heartbeater.cc:347] Connected to a master server at 127.27.41.190:45157
I20260810 06:43:41.312618 17656 heartbeater.cc:464] Registering TS with master...
I20260810 06:43:41.312804 17656 heartbeater.cc:511] Master 127.27.41.190:45157 requested a full tablet report, sending...
I20260810 06:43:41.313277 17180 ts_manager.cc:194] Registered new tserver with Master: c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813)
I20260810 06:43:41.313684 17180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:52965
W20260810 06:43:41.387884 17660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:43:41.388116 17660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:43:41.388156 17660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:43:41.389299 17660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:43:41.389386 17660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:43:41.389433 17660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:43:41.391034 17660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:32901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:46271
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=43777
--tserver_master_addrs=127.27.41.190:45157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:43:41.391324 17660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:43:41.391553 17660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:43:41.397068 17670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:41.397179 17660 server_base.cc:1034] running on GCE node
W20260810 06:43:41.397086 17671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:43:41.397105 17673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:43:41.397482 17660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:43:41.397742 17660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:43:41.398912 17660 hybrid_clock.cc:648] HybridClock initialized: now 1786344221398898 us; error 27 us; skew 500 ppm
Aug 10 06:43:41 dist-test-slave-bw88 krb5kdc[16331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344221, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:43:41.401557 17660 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:43:41.402004 17660 webserver.cc:460] Webserver started at http://127.27.41.131:43777/ using document root <none> and password file <none>
I20260810 06:43:41.402254 17660 fs_manager.cc:359] Metadata directory not provided
I20260810 06:43:41.402354 17660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:43:41.403648 17660 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:43:41.404243 17682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:41.404414 17660 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:43:41.404515 17660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "f8fcce10b7104179a6be17c3a4159b31"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "9f34da69a5393cdb0e886a4295174660"
server_key_iv: "73d567e90bcf246fdc23ee6bd336f476"
server_key_version: "encryptionkey@0"
I20260810 06:43:41.404863 17660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:43:41.412289 17660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:43:41.414521 17660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:43:41.414695 17660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:43:41.414935 17660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:43:41.415289 17660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:43:41.415333 17660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:41.415367 17660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:43:41.415390 17660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:43:41.424265 17660 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:46271
I20260810 06:43:41.424335 17856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:46271 every 8 connection(s)
I20260810 06:43:41.424705 17660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:43:41.428293 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 17660
Aug 10 06:43:41 dist-test-slave-bw88 krb5kdc[16331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344221, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:43:41.436762 17468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.425646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:43773 (local address 127.27.41.190:45157)
0810 06:43:41.425723 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:41.425726 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:41.425938 (+ 212us) server_negotiation.cc:407] Connection header received
0810 06:43:41.426440 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:41.426441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:41.426456 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:41.426545 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:41.427456 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.428369 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.430151 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.430434 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.430506 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.432999 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:41.433000 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:41.433001 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:41.433008 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:41.434701 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:41.435603 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:41.435605 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:41.435605 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:41.435661 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:41.436002 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:41.436003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:41.436004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:41.436122 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:41.436175 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:41.436541 (+ 366us) server_negotiation.cc:299] Negotiation successful
0810 06:43:41.436633 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 06:43:41.437276 17861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.425620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:43773)
0810 06:43:41.425805 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:41.425848 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:41.426339 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:41.426599 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:41.426602 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:41.427172 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:43:41.427363 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.427369 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.428504 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.428505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.430055 (+ 1550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.430059 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.430527 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.430528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.430697 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.431315 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:43:41.431323 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:43:41.432901 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:43:41.435156 (+ 2255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:41.435164 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:41.435167 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:41.435508 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:41.435742 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:43:41.435743 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:43:41.435743 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:43:41.435918 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:43:41.436190 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:43:41.436196 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:43:41.436381 (+ 185us) client_negotiation.cc:769] Sending connection context
0810 06:43:41.436512 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 06:43:41.436714 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
I20260810 06:43:41.437476 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.428726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56188 (local address 127.27.41.190:45157)
0810 06:43:41.428836 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:41.428838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:41.428989 (+ 151us) server_negotiation.cc:407] Connection header received
0810 06:43:41.429073 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:41.429074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:41.429086 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:41.429142 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:41.429804 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.430429 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.432155 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.432472 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.432537 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.434207 (+ 1670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:41.434209 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:41.434209 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:41.434217 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:41.435924 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:41.436462 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:41.436463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:41.436464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:41.436541 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:41.436774 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:41.436775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:41.436776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:41.436899 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:41.437000 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:41.437241 (+ 241us) server_negotiation.cc:299] Negotiation successful
0810 06:43:41.437324 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":59,"threads_started":1}
I20260810 06:43:41.438189 17857 heartbeater.cc:347] Connected to a master server at 127.27.41.190:45157
I20260810 06:43:41.438297 17857 heartbeater.cc:464] Registering TS with master...
I20260810 06:43:41.438482 17857 heartbeater.cc:511] Master 127.27.41.190:45157 requested a full tablet report, sending...
I20260810 06:43:41.438887 17179 ts_manager.cc:194] Registered new tserver with Master: f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271)
I20260810 06:43:41.439486 17179 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:43773
I20260810 06:43:41.449098 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:43:41.452497 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.449563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56202 (local address 127.27.41.190:45157)
0810 06:43:41.449608 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:41.449610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:41.449751 (+ 141us) server_negotiation.cc:407] Connection header received
0810 06:43:41.449833 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:41.449834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:41.449862 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:41.449918 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:43:41.450061 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.450638 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.451888 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.452064 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.452116 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.452310 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:43:41.452348 (+ 38us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0810 06:43:41.452457 (+ 109us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56202: token expired
Metrics: {"server-negotiator.queue_time_us":22}
W20260810 06:43:41.452562 17862 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56202: token expired
W20260810 06:43:41.452775 17077 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.27.41.190:45157)
I20260810 06:43:41.459417 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.453039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56218 (local address 127.27.41.190:45157)
0810 06:43:41.453080 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:41.453083 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:41.453198 (+ 115us) server_negotiation.cc:407] Connection header received
0810 06:43:41.453269 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:41.453270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:41.453280 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:41.453323 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:43:41.453883 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.454403 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.455228 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.455419 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.455492 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.456712 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:43:41.456714 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:43:41.456714 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:43:41.456720 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:43:41.458230 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:41.458610 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:41.458611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:41.458612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:41.458669 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:43:41.458887 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:43:41.458888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:43:41.458888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:43:41.459020 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:43:41.459143 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:41.459248 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 06:43:41.459327 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260810 06:43:41.460654 17179 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56218:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:43:41.462359 17179 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:43:41.464663 17339 tablet_service.cc:1467] Processing CreateTablet for tablet 098cfb9d47ec435b9cf6f60e03d720d8 (DEFAULT_TABLE table=test-table [id=fc536d2e87d14cd48dc8af50b7fa1c42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:43:41.464865 17339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 098cfb9d47ec435b9cf6f60e03d720d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:41.466336 17303 tablet_bootstrap.cc:492] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9: Bootstrap starting.
I20260810 06:43:41.466706 17303 tablet_bootstrap.cc:654] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:41.467360 17303 tablet_bootstrap.cc:492] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9: No bootstrap required, opened a new log
I20260810 06:43:41.467412 17303 ts_tablet_manager.cc:1397] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:43:41.467847 17303 raft_consensus.cc:348] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:43:41.467926 17303 raft_consensus.cc:374] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:41.467988 17303 raft_consensus.cc:729] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77fae6dce3e4d70960fde49d8a3a3e9, State: Initialized, Role: FOLLOWER
I20260810 06:43:41.468035 17303 consensus_queue.cc:260] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:43:41.468132 17303 ts_tablet_manager.cc:1428] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:43:41.470778 17477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.464181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:33813 (local address 127.0.0.1:55778)
0810 06:43:41.464289 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:41.464300 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:41.464332 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:41.467414 (+ 3082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:41.467416 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:41.467418 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:41.467456 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.467457 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.468845 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.468845 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.469635 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.469638 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.470539 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.470540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.470600 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.470603 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:43:41.470666 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 06:43:41.470711 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260810 06:43:41.470798 17867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.464374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55778 (local address 127.27.41.130:33813)
0810 06:43:41.467182 (+ 2808us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:41.467188 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:41.467199 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:43:41.467284 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:41.467288 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:41.467305 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:41.467542 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:41.467675 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.468742 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.469721 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.470446 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.470539 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.470606 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:41.470681 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 06:43:41.470719 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2766,"thread_start_us":111,"threads_started":1}
I20260810 06:43:41.471309 17866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.464213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:46271 (local address 127.0.0.1:60132)
0810 06:43:41.464575 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:41.464586 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:41.464638 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:41.466250 (+ 1612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:41.466251 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:41.466254 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:41.466300 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.466302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.468045 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.468046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.469427 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.469431 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.471087 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.471088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.471136 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.471139 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:43:41.471204 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 06:43:41.471247 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":64,"threads_started":1}
I20260810 06:43:41.471367 17869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.464523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60132 (local address 127.27.41.131:46271)
0810 06:43:41.466058 (+ 1535us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:41.466064 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:41.466075 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:43:41.466119 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:41.466121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:41.466139 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:41.466230 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:41.466368 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.467919 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.469540 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.470441 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.470547 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.470606 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:41.471238 (+ 632us) server_negotiation.cc:299] Negotiation successful
0810 06:43:41.471283 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1497,"thread_start_us":1377,"threads_started":1}
I20260810 06:43:41.471709 17558 tablet_service.cc:1467] Processing CreateTablet for tablet 098cfb9d47ec435b9cf6f60e03d720d8 (DEFAULT_TABLE table=test-table [id=fc536d2e87d14cd48dc8af50b7fa1c42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:43:41.472132 17558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 098cfb9d47ec435b9cf6f60e03d720d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:41.473953 17742 tablet_service.cc:1467] Processing CreateTablet for tablet 098cfb9d47ec435b9cf6f60e03d720d8 (DEFAULT_TABLE table=test-table [id=fc536d2e87d14cd48dc8af50b7fa1c42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:43:41.474261 17742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 098cfb9d47ec435b9cf6f60e03d720d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:43:41.476521 17871 tablet_bootstrap.cc:492] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a: Bootstrap starting.
I20260810 06:43:41.477097 17873 tablet_bootstrap.cc:492] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31: Bootstrap starting.
I20260810 06:43:41.477507 17871 tablet_bootstrap.cc:654] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:41.477950 17873 tablet_bootstrap.cc:654] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31: Neither blocks nor log segments found. Creating new log.
I20260810 06:43:41.478111 17871 log.cc:824] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:41.478613 17873 log.cc:824] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31: Log is configured to *not* fsync() on all Append() calls
I20260810 06:43:41.478968 17871 tablet_bootstrap.cc:492] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a: No bootstrap required, opened a new log
I20260810 06:43:41.479053 17871 ts_tablet_manager.cc:1397] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:43:41.479526 17873 tablet_bootstrap.cc:492] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31: No bootstrap required, opened a new log
I20260810 06:43:41.479655 17873 ts_tablet_manager.cc:1397] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:43:41.480508 17871 raft_consensus.cc:348] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:43:41.480886 17871 raft_consensus.cc:374] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:41.480943 17871 raft_consensus.cc:729] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c35ef0117a064e1e9a7df7b8127b2f8a, State: Initialized, Role: FOLLOWER
I20260810 06:43:41.481081 17871 consensus_queue.cc:260] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:43:41.481431 17871 ts_tablet_manager.cc:1428] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 06:43:41.481452 17656 heartbeater.cc:503] Master 127.27.41.190:45157 was elected leader, sending a full tablet report...
I20260810 06:43:41.482725 17873 raft_consensus.cc:348] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:43:41.482931 17873 raft_consensus.cc:374] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:43:41.482975 17873 raft_consensus.cc:729] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8fcce10b7104179a6be17c3a4159b31, State: Initialized, Role: FOLLOWER
I20260810 06:43:41.483105 17873 consensus_queue.cc:260] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:43:41.483399 17873 ts_tablet_manager.cc:1428] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 06:43:41.483423 17857 heartbeater.cc:503] Master 127.27.41.190:45157 was elected leader, sending a full tablet report...
I20260810 06:43:41.528391 17880 raft_consensus.cc:482] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:43:41.528527 17880 raft_consensus.cc:504] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:43:41.528869 17880 leader_election.cc:288] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271), b77fae6dce3e4d70960fde49d8a3a3e9 (127.27.41.129:37213)
I20260810 06:43:41.531844 17869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.529237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:53735 (local address 127.27.41.131:46271)
0810 06:43:41.529298 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:41.529300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:41.529310 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:43:41.529368 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:41.529369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:41.529378 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:41.529454 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:41.529636 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.530104 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.531067 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.531456 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.531545 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.531554 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:41.531715 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 06:43:41.531758 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 06:43:41.531888 17882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.529061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:46271 (local address 127.27.41.130:53735)
0810 06:43:41.529246 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:41.529255 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:41.529302 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:41.529459 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:41.529460 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:41.529461 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:41.529544 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.529546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.530189 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.530190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.530967 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.530970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.531545 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.531546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.531628 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.531632 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:43:41.531695 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 06:43:41.531738 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":24,"thread_start_us":98,"threads_started":1}
I20260810 06:43:41.531888 17478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.529156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:50315 (local address 127.27.41.129:37213)
0810 06:43:41.529218 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:41.529220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:41.529230 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:43:41.529263 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:41.529264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:41.529276 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:41.529391 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:43:41.529594 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.530075 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.531076 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.531466 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.531562 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.531570 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:41.531753 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 06:43:41.531791 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 06:43:41.531893 17659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.529051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:37213 (local address 127.27.41.130:50315)
0810 06:43:41.529113 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:41.529126 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:43:41.529170 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:43:41.529405 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:43:41.529407 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:43:41.529409 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:43:41.529498 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.529500 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.530165 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.530166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.530965 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:43:41.530967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.531572 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.531573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:43:41.531668 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.531671 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:43:41.531734 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 06:43:41.531775 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":47}
I20260810 06:43:41.532238 17790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "098cfb9d47ec435b9cf6f60e03d720d8" candidate_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8fcce10b7104179a6be17c3a4159b31" is_pre_election: true
I20260810 06:43:41.532428 17790 raft_consensus.cc:2454] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c35ef0117a064e1e9a7df7b8127b2f8a in term 0.
I20260810 06:43:41.532423 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "098cfb9d47ec435b9cf6f60e03d720d8" candidate_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" is_pre_election: true
I20260810 06:43:41.532586 17385 raft_consensus.cc:2454] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c35ef0117a064e1e9a7df7b8127b2f8a in term 0.
I20260810 06:43:41.532706 17500 leader_election.cc:302] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c35ef0117a064e1e9a7df7b8127b2f8a, f8fcce10b7104179a6be17c3a4159b31; no voters:
I20260810 06:43:41.532855 17880 raft_consensus.cc:2781] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:43:41.532944 17880 raft_consensus.cc:482] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:43:41.532980 17880 raft_consensus.cc:3037] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:41.533816 17880 raft_consensus.cc:504] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:43:41.533972 17880 leader_election.cc:288] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [CANDIDATE]: Term 1 election: Requested vote from peers f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271), b77fae6dce3e4d70960fde49d8a3a3e9 (127.27.41.129:37213)
I20260810 06:43:41.534159 17790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "098cfb9d47ec435b9cf6f60e03d720d8" candidate_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8fcce10b7104179a6be17c3a4159b31"
I20260810 06:43:41.534147 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "098cfb9d47ec435b9cf6f60e03d720d8" candidate_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9"
I20260810 06:43:41.534255 17790 raft_consensus.cc:3037] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:41.534252 17385 raft_consensus.cc:3037] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:43:41.534992 17790 raft_consensus.cc:2454] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c35ef0117a064e1e9a7df7b8127b2f8a in term 1.
I20260810 06:43:41.535006 17385 raft_consensus.cc:2454] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c35ef0117a064e1e9a7df7b8127b2f8a in term 1.
I20260810 06:43:41.535234 17503 leader_election.cc:302] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b77fae6dce3e4d70960fde49d8a3a3e9, c35ef0117a064e1e9a7df7b8127b2f8a; no voters:
I20260810 06:43:41.535372 17880 raft_consensus.cc:2781] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:43:41.535547 17880 raft_consensus.cc:686] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [term 1 LEADER]: Becoming Leader. State: Replica: c35ef0117a064e1e9a7df7b8127b2f8a, State: Running, Role: LEADER
I20260810 06:43:41.535665 17880 consensus_queue.cc:237] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:43:41.536538 17179 catalog_manager.cc:5495] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a reported cstate change: term changed from 0 to 1, leader changed from <none> to c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130). New cstate: current_term: 1 leader_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } health_report { overall_health: UNKNOWN } } }
I20260810 06:43:41.545814 17867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.543345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55784 (local address 127.27.41.130:33813)
0810 06:43:41.543410 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 06:43:41.543412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:43:41.543437 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:43:41.543471 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:43:41.543474 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:43:41.543495 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:43:41.543568 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:43:41.543722 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.544182 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.544938 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:43:41.545140 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:43:41.545219 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:43:41.545422 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:43:41.545515 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:43:41.545619 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 06:43:41.545684 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 06:43:41.545704 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 06:43:41.547621 17790 raft_consensus.cc:1261] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31 [term 1 FOLLOWER]: Refusing update from remote peer c35ef0117a064e1e9a7df7b8127b2f8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:43:41.547646 17385 raft_consensus.cc:1261] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Refusing update from remote peer c35ef0117a064e1e9a7df7b8127b2f8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:43:41.548018 17883 consensus_queue.cc:1035] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:43:41.548156 17880 consensus_queue.cc:1035] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:43:41.550976 17891 mvcc.cc:205] Tried to move back new op lower bound from 7316865931456098304 to 7316865931410657280. Current Snapshot: MvccSnapshot[applied={T|T < 7316865931456098304}]
I20260810 06:43:41.552896 17178 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:43:41.553012 17178 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:43:41.553797 17178 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Sending DeleteTablet for 3 replicas of tablet 098cfb9d47ec435b9cf6f60e03d720d8
I20260810 06:43:41.554208 17339 tablet_service.cc:1514] Processing DeleteTablet for tablet 098cfb9d47ec435b9cf6f60e03d720d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:41 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:35298
I20260810 06:43:41.554184 17742 tablet_service.cc:1514] Processing DeleteTablet for tablet 098cfb9d47ec435b9cf6f60e03d720d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:41 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:60132
I20260810 06:43:41.554242 17558 tablet_service.cc:1514] Processing DeleteTablet for tablet 098cfb9d47ec435b9cf6f60e03d720d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:43:41 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:55778
I20260810 06:43:41.554299 17479 tablet_replica.cc:330] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9: stopping tablet replica
I20260810 06:43:41.554350 17479 raft_consensus.cc:2229] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:43:41.554409 17479 raft_consensus.cc:2258] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:43:41.554656 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 17244
I20260810 06:43:41.554761 17479 ts_tablet_manager.cc:1905] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:43:41.558235 17901 tablet_replica.cc:330] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a: stopping tablet replica
I20260810 06:43:41.558373 17901 raft_consensus.cc:2229] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:43:41.558504 17901 raft_consensus.cc:2258] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:43:41.559381 17901 ts_tablet_manager.cc:1905] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:43:41.561965 17901 ts_tablet_manager.cc:1918] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:43:41.562060 17901 log.cc:1196] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/098cfb9d47ec435b9cf6f60e03d720d8
I20260810 06:43:41.562480 17901 ts_tablet_manager.cc:1939] T 098cfb9d47ec435b9cf6f60e03d720d8 P c35ef0117a064e1e9a7df7b8127b2f8a: Deleting consensus metadata
I20260810 06:43:41.564807 17164 catalog_manager.cc:4841] TS c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813): tablet 098cfb9d47ec435b9cf6f60e03d720d8 (table test-table [id=fc536d2e87d14cd48dc8af50b7fa1c42]) successfully deleted
I20260810 06:43:41.569515 17900 tablet_replica.cc:330] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31: stopping tablet replica
I20260810 06:43:41.569681 17900 raft_consensus.cc:2229] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:43:41.569832 17900 raft_consensus.cc:2258] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:43:41.570379 17900 ts_tablet_manager.cc:1905] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:43:41.572440 17900 ts_tablet_manager.cc:1918] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:43:41.572526 17900 log.cc:1196] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/098cfb9d47ec435b9cf6f60e03d720d8
I20260810 06:43:41.572830 17900 ts_tablet_manager.cc:1939] T 098cfb9d47ec435b9cf6f60e03d720d8 P f8fcce10b7104179a6be17c3a4159b31: Deleting consensus metadata
I20260810 06:43:41.573414 17160 catalog_manager.cc:4841] TS f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271): tablet 098cfb9d47ec435b9cf6f60e03d720d8 (table test-table [id=fc536d2e87d14cd48dc8af50b7fa1c42]) successfully deleted
W20260810 06:43:41.573848 17164 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:37213 (error 108)
I20260810 06:43:41.574177 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 17471
I20260810 06:43:41.577646 17866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:43:41.574353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:37213 (local address 127.0.0.1:35306)
0810 06:43:41.577534 (+ 3181us) negotiation.cc:107] Waiting for socket to connect
0810 06:43:41.577600 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:37213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3149}
W20260810 06:43:41.578378 17164 catalog_manager.cc:4584] TS b77fae6dce3e4d70960fde49d8a3a3e9 (127.27.41.129:37213): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 098cfb9d47ec435b9cf6f60e03d720d8: Network error: Client connection negotiation failed: client connection to 127.27.41.129:37213: connect: Connection refused (error 111)
I20260810 06:43:41.586692 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 17660
I20260810 06:43:41.597074 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 17137
I20260810 06:44:01.608695 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:45157
--webserver_interface=127.27.41.190
--webserver_port=35775
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:32901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:45157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:01.692113 17904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:01.692301 17904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:01.692322 17904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:01.693614 17904 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 06:44:01.693655 17904 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 06:44:01.693668 17904 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 06:44:01.693679 17904 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:01.693693 17904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:01.693706 17904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:01.693718 17904 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:01.693737 17904 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:01.695129 17904 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:32901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:45157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:45157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=35775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:01.695313 17904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:01.695472 17904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:01.700783 17910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:01.700779 17909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:01.700767 17913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:01.700850 17904 server_base.cc:1034] running on GCE node
I20260810 06:44:01.701314 17904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:01.701633 17904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:01.702806 17904 hybrid_clock.cc:648] HybridClock initialized: now 1786344241702802 us; error 37 us; skew 500 ppm
Aug 10 06:44:01 dist-test-slave-bw88 krb5kdc[16331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344241, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:01.705241 17904 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:44:01.705724 17904 webserver.cc:460] Webserver started at http://127.27.41.190:35775/ using document root <none> and password file <none>
I20260810 06:44:01.705942 17904 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:01.706012 17904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:01.707330 17904 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:44:01.707998 17923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:01.708165 17904 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:01.708276 17904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "50da086ebf274d118017a93bc5b8c185"
format_stamp: "Formatted at 2026-08-10 06:43:19 on dist-test-slave-bw88"
server_key: "f2ef7137e19117810cbed6428d0ffe0f"
server_key_iv: "e523a7eae392cdcda2ef5538b69b1fd9"
server_key_version: "encryptionkey@0"
I20260810 06:44:01.708616 17904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:01.722790 17904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:01.724531 17904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:01.724697 17904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:01.728883 17904 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:45157
I20260810 06:44:01.728919 18008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:45157 every 8 connection(s)
I20260810 06:44:01.729287 17904 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:01.730799 18009 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:44:01.731482 18009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Bootstrap starting.
I20260810 06:44:01.735402 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 17904
I20260810 06:44:01.735749 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:37213
--local_ip_for_outbound_sockets=127.27.41.129
--tserver_master_addrs=127.27.41.190:45157
--webserver_port=33027
--webserver_interface=127.27.41.129
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:32901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:44:01.741478 18009 log.cc:824] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:01.743626 18009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:44:01.743932 18009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Bootstrap complete.
I20260810 06:44:01.746245 18009 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } }
I20260810 06:44:01.746455 18009 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da086ebf274d118017a93bc5b8c185, State: Initialized, Role: FOLLOWER
I20260810 06:44:01.746624 18009 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } }
I20260810 06:44:01.746685 18009 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:01.746743 18009 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:01.746793 18009 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 2 FOLLOWER]: Advancing to term 3
I20260810 06:44:01.747762 18009 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } }
I20260810 06:44:01.747849 18009 leader_election.cc:302] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50da086ebf274d118017a93bc5b8c185; no voters:
I20260810 06:44:01.748050 18009 leader_election.cc:288] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 06:44:01.748114 18016 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 06:44:01.748262 18016 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [term 3 LEADER]: Becoming Leader. State: Replica: 50da086ebf274d118017a93bc5b8c185, State: Running, Role: LEADER
I20260810 06:44:01.748315 18009 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:01.748447 18016 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } }
I20260810 06:44:01.749091 18018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50da086ebf274d118017a93bc5b8c185. Latest consensus state: current_term: 3 leader_uuid: "50da086ebf274d118017a93bc5b8c185" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } } }
I20260810 06:44:01.749182 18018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:01.749400 18029 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:01.749449 18017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "50da086ebf274d118017a93bc5b8c185" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50da086ebf274d118017a93bc5b8c185" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 45157 } } }
I20260810 06:44:01.749655 18017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:01.750234 18029 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:01.750337 18029 catalog_manager.cc:1259] Loaded cluster ID: ca53ada575de4d6a8491f38c9a5a57a2
I20260810 06:44:01.750372 18029 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:01.751770 18029 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:01.751953 18029 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Loaded TSK: 0
I20260810 06:44:01.752004 18029 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 50da086ebf274d118017a93bc5b8c185: Loaded TSK: 1
F20260810 06:44:01.752225 18029 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f64366f09ad google::LogMessage::Fail() at ??:0
@ 0x7f64366f388a google::LogMessage::SendToLog() at ??:0
@ 0x7f64366f04de google::LogMessage::Flush() at ??:0
@ 0x7f64366f1a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6438e5d104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f6438e5ad41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f643e64a1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f643e64a48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f643e64a594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f643e610c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f643e61aad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f64385be0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f64385b3954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f64394176db start_thread at ??:0
@ 0x7f64351ee61f clone at ??:0
W20260810 06:44:01.839728 18012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:01.839920 18012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:01.839948 18012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:01.841086 18012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:01.841127 18012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:01.841176 18012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:44:01.842722 18012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:32901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:37213
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=33027
--tserver_master_addrs=127.27.41.190:45157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:01.842963 18012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:01.843205 18012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:01.848264 18070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:01.848378 18072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:01.848296 18069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:01.848619 18012 server_base.cc:1034] running on GCE node
I20260810 06:44:01.848834 18012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:01.849099 18012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:01.850265 18012 hybrid_clock.cc:648] HybridClock initialized: now 1786344241850253 us; error 28 us; skew 500 ppm
Aug 10 06:44:01 dist-test-slave-bw88 krb5kdc[16331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344241, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:01.852871 18012 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:44:01.853415 18012 webserver.cc:460] Webserver started at http://127.27.41.129:33027/ using document root <none> and password file <none>
I20260810 06:44:01.853663 18012 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:01.853710 18012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:01.855151 18012 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:44:01.856050 18082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:01.856254 18012 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:44:01.856372 18012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "b77fae6dce3e4d70960fde49d8a3a3e9"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "8718c11396581ff68cc6a875fe122c88"
server_key_iv: "1664dbf6439595b8818180f2dae53352"
server_key_version: "encryptionkey@0"
I20260810 06:44:01.856737 18012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:01.872285 18012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:01.874521 18012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:01.874689 18012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:01.874919 18012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:01.875379 18089 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 06:44:01.877401 18012 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 06:44:01.877468 18012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 06:44:01.877511 18012 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 06:44:01.878144 18012 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 06:44:01.878199 18012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 06:44:01.878285 18089 tablet_bootstrap.cc:492] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9: Bootstrap starting.
I20260810 06:44:01.880335 18089 log.cc:824] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:01.883446 18089 tablet_bootstrap.cc:492] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:44:01.883786 18089 tablet_bootstrap.cc:492] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9: Bootstrap complete.
I20260810 06:44:01.883927 18089 ts_tablet_manager.cc:1397] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.002s
I20260810 06:44:01.886014 18012 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:37213
I20260810 06:44:01.886054 18244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:37213 every 8 connection(s)
I20260810 06:44:01.885823 18089 raft_consensus.cc:348] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:44:01.886266 18089 raft_consensus.cc:729] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77fae6dce3e4d70960fde49d8a3a3e9, State: Initialized, Role: FOLLOWER
I20260810 06:44:01.886420 18012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:44:01.886449 18089 consensus_queue.cc:260] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:44:01.886746 18089 ts_tablet_manager.cc:1428] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:44:01.892023 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 18012
I20260810 06:44:01.892405 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:33813
--local_ip_for_outbound_sockets=127.27.41.130
--tserver_master_addrs=127.27.41.190:45157
--webserver_port=39173
--webserver_interface=127.27.41.130
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:32901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:01.969260 18252 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:01.887292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:44577)
0810 06:44:01.887455 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:01.887498 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:01.887659 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:01.969033 (+ 81374us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":63,"threads_started":1}
W20260810 06:44:01.969564 18246 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:45157 (0 consecutive failures): Network error: Failed to ping master at 127.27.41.190:45157: Client connection negotiation failed: client connection to 127.27.41.190:45157: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 06:44:01.969916 18252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:01.969783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:54885)
0810 06:44:01.969842 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:01.969882 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 06:44:01.970302 18252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:01.970215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:43239)
0810 06:44:01.970262 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:01.970287 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 06:44:01.970466 18246 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:44:01.993444 18253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:01.993680 18253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:01.993721 18253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:01.994853 18253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:01.994953 18253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:01.995002 18253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:44:01.996410 18253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:32901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:33813
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=39173
--tserver_master_addrs=127.27.41.190:45157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:01.996665 18253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:01.996883 18253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:02.001924 18265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:02.001986 18262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:02.001972 18263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:02.002132 18253 server_base.cc:1034] running on GCE node
I20260810 06:44:02.002372 18253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:02.002662 18253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:02.003834 18253 hybrid_clock.cc:648] HybridClock initialized: now 1786344242003821 us; error 29 us; skew 500 ppm
Aug 10 06:44:02 dist-test-slave-bw88 krb5kdc[16331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344242, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:02.006373 18253 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:44:02.006765 18253 webserver.cc:460] Webserver started at http://127.27.41.130:39173/ using document root <none> and password file <none>
I20260810 06:44:02.006937 18253 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:02.006976 18253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:02.008196 18253 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:44:02.008865 18273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:02.009058 18253 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:44:02.009162 18253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "c35ef0117a064e1e9a7df7b8127b2f8a"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "ee5a9facdda346085fc82edb02716c75"
server_key_iv: "e1e213fc6a7e889a7e37c5f27b9daf45"
server_key_version: "encryptionkey@0"
I20260810 06:44:02.009532 18253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:02.019500 18253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:02.021767 18253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:02.021875 18253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:02.022060 18253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:02.022305 18253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:02.022336 18253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:02.022356 18253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:02.022368 18253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:02.028211 18253 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:33813
I20260810 06:44:02.028285 18427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:33813 every 8 connection(s)
I20260810 06:44:02.028636 18253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:44:02.029175 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 18253
I20260810 06:44:02.029503 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:46271
--local_ip_for_outbound_sockets=127.27.41.131
--tserver_master_addrs=127.27.41.190:45157
--webserver_port=43777
--webserver_interface=127.27.41.131
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:32901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:44:02.029786 18433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:02.029340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:39501)
0810 06:44:02.029566 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:02.029641 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":108,"threads_started":1}
W20260810 06:44:02.031666 18429 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:45157 (0 consecutive failures): Network error: Failed to ping master at 127.27.41.190:45157: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
I20260810 06:44:02.032019 18433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:02.031864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:44403)
0810 06:44:02.031944 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:02.031989 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 06:44:02.032409 18433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:02.032305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:49435)
0810 06:44:02.032352 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:02.032380 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 06:44:02.032562 18429 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:44:02.113240 18435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:02.113462 18435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:02.113493 18435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:02.114591 18435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:02.114631 18435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:02.114656 18435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:44:02.116122 18435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:32901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:46271
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=43777
--tserver_master_addrs=127.27.41.190:45157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:02.116367 18435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:02.116613 18435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:02.121797 18447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:02.121804 18450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:02.121950 18435 server_base.cc:1034] running on GCE node
W20260810 06:44:02.121846 18446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:02.122241 18435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:02.122529 18435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:02.123734 18435 hybrid_clock.cc:648] HybridClock initialized: now 1786344242123708 us; error 43 us; skew 500 ppm
Aug 10 06:44:02 dist-test-slave-bw88 krb5kdc[16331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344242, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:02.126525 18435 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:44:02.127010 18435 webserver.cc:460] Webserver started at http://127.27.41.131:43777/ using document root <none> and password file <none>
I20260810 06:44:02.127260 18435 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:02.127310 18435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:02.128737 18435 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:44:02.129402 18459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:02.129578 18435 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:44:02.129685 18435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "f8fcce10b7104179a6be17c3a4159b31"
format_stamp: "Formatted at 2026-08-10 06:43:20 on dist-test-slave-bw88"
server_key: "9f34da69a5393cdb0e886a4295174660"
server_key_iv: "73d567e90bcf246fdc23ee6bd336f476"
server_key_version: "encryptionkey@0"
I20260810 06:44:02.130041 18435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:02.158316 18435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:02.160678 18435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:02.160799 18435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:02.160974 18435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:02.161371 18435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:02.161427 18435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:02.161451 18435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:02.161494 18435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:02.167431 18435 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:46271
I20260810 06:44:02.167523 18619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:46271 every 8 connection(s)
I20260810 06:44:02.167848 18435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:44:02.168902 18622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:02.168520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:40811)
0810 06:44:02.168696 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:02.168764 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":93,"threads_started":1}
W20260810 06:44:02.169281 18620 heartbeater.cc:644] Failed to heartbeat to 127.27.41.190:45157 (0 consecutive failures): Network error: Failed to ping master at 127.27.41.190:45157: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
I20260810 06:44:02.169644 18622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:02.169542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:41821)
0810 06:44:02.169595 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:02.169625 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 06:44:02.169906 18622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:02.169825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:34561)
0810 06:44:02.169866 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:02.169888 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 06:44:02.170033 18620 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 06:44:02.176105 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 18435
I20260810 06:44:02.971097 18626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:02.970850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:45601)
0810 06:44:02.970984 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:02.971020 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260810 06:44:03.033110 18627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:03.032884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:37249)
0810 06:44:03.033018 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:03.033053 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":66,"threads_started":1}
I20260810 06:44:03.170568 18628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:03.170345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:42253)
0810 06:44:03.170486 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:03.170520 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":76,"threads_started":1}
I20260810 06:44:03.608675 18630 raft_consensus.cc:482] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:44:03.608803 18630 raft_consensus.cc:504] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:44:03.609221 18630 leader_election.cc:288] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813), f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271)
Aug 10 06:44:03 dist-test-slave-bw88 krb5kdc[16331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344241, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.131@KRBTEST.COM
Aug 10 06:44:03 dist-test-slave-bw88 krb5kdc[16331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344241, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.130@KRBTEST.COM
I20260810 06:44:03.620690 18633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:03.609517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:41855 (local address 127.27.41.130:33813)
0810 06:44:03.609703 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:03.609716 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:03.609743 (+ 27us) server_negotiation.cc:407] Connection header received
0810 06:44:03.610333 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:03.610336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:03.610396 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:03.610554 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:03.611397 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:03.612340 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:03.613462 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:03.613876 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:03.614002 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:03.616924 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:03.616927 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:03.616927 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:03.616937 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:03.618941 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:03.619289 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:03.619292 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:03.619292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:03.619390 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:03.619639 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:03.619640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:03.619640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:03.619966 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:03.620057 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:03.620436 (+ 379us) server_negotiation.cc:299] Negotiation successful
0810 06:44:03.620582 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
I20260810 06:44:03.620690 18634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:03.609585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:44521 (local address 127.27.41.131:46271)
0810 06:44:03.609738 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:03.609746 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:03.609782 (+ 36us) server_negotiation.cc:407] Connection header received
0810 06:44:03.610332 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:03.610336 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:03.610396 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:03.610553 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:03.611618 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:03.612645 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:03.613481 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:03.613875 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:03.614010 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:03.616484 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:03.616487 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:03.616488 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:03.616497 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:03.618645 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:03.619158 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:03.619161 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:03.619161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:03.619269 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:03.619640 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:03.619641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:03.619641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:03.619966 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:03.620057 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:03.620436 (+ 379us) server_negotiation.cc:299] Negotiation successful
0810 06:44:03.620573 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
I20260810 06:44:03.620700 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:03.609399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:33813 (local address 127.27.41.129:41855)
0810 06:44:03.609675 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:03.609684 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:03.609720 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:03.610691 (+ 971us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:03.610692 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:03.610966 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:03.611237 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:03.611243 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:03.612489 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:03.612490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:03.613375 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:03.613379 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:03.613975 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:03.613976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:03.614106 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:03.614782 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:03.614787 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:03.616824 (+ 2037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:03.619013 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:03.619014 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:03.619015 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:03.619216 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:03.619481 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:03.619482 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:03.619482 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:03.619556 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:03.620059 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:03.620069 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:03.620231 (+ 162us) client_negotiation.cc:769] Sending connection context
0810 06:44:03.620358 (+ 127us) client_negotiation.cc:240] Negotiation successful
0810 06:44:03.620563 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":26,"thread_start_us":66,"threads_started":1}
I20260810 06:44:03.621206 18631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:03.609399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:46271 (local address 127.27.41.129:44521)
0810 06:44:03.609518 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:03.609528 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:03.609588 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:03.610620 (+ 1032us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:03.610622 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:03.610967 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:03.611464 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:03.611467 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:03.612740 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:03.612741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:03.613378 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:03.613381 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:03.613974 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:03.613975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:03.614105 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:03.614725 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:03.614734 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:03.616365 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:03.618740 (+ 2375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:03.618749 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:03.618751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:03.619076 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:03.619365 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:03.619366 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:03.619367 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:03.619555 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:03.620059 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:03.620068 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:03.620231 (+ 163us) client_negotiation.cc:769] Sending connection context
0810 06:44:03.620367 (+ 136us) client_negotiation.cc:240] Negotiation successful
0810 06:44:03.620621 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":116,"thread_start_us":50,"threads_started":1}
W20260810 06:44:03.621922 18086 leader_election.cc:341] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813): Not found: Tablet not found: 098cfb9d47ec435b9cf6f60e03d720d8
W20260810 06:44:03.622032 18083 leader_election.cc:341] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271): Not found: Tablet not found: 098cfb9d47ec435b9cf6f60e03d720d8
I20260810 06:44:03.622112 18083 leader_election.cc:302] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77fae6dce3e4d70960fde49d8a3a3e9; no voters: c35ef0117a064e1e9a7df7b8127b2f8a, f8fcce10b7104179a6be17c3a4159b31
I20260810 06:44:03.622215 18630 raft_consensus.cc:2726] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:44:03.971736 18631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:03.971597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:50337)
0810 06:44:03.971657 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:03.971694 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 06:44:04.033844 18635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:04.033603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:59647)
0810 06:44:04.033738 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:04.033795 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260810 06:44:04.171227 18637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:04.171029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:36839)
0810 06:44:04.171151 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:04.171186 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260810 06:44:04.972616 18638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:04.972333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:32933)
0810 06:44:04.972516 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:04.972565 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":90,"threads_started":1}
I20260810 06:44:05.034588 18642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:05.034333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:59769)
0810 06:44:05.034499 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:05.034546 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":82,"threads_started":1}
I20260810 06:44:05.172156 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:05.171816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:38537)
0810 06:44:05.172050 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:05.172111 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":69,"threads_started":1}
I20260810 06:44:05.625551 18648 raft_consensus.cc:482] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:44:05.625725 18648 raft_consensus.cc:504] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:44:05.625941 18648 leader_election.cc:288] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813), f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271)
W20260810 06:44:05.626317 18083 leader_election.cc:341] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271): Not found: Tablet not found: 098cfb9d47ec435b9cf6f60e03d720d8
W20260810 06:44:05.626415 18086 leader_election.cc:341] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813): Not found: Tablet not found: 098cfb9d47ec435b9cf6f60e03d720d8
I20260810 06:44:05.626562 18086 leader_election.cc:302] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77fae6dce3e4d70960fde49d8a3a3e9; no voters: c35ef0117a064e1e9a7df7b8127b2f8a, f8fcce10b7104179a6be17c3a4159b31
I20260810 06:44:05.626636 18648 raft_consensus.cc:2726] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:44:05.973464 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:05.973162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:47545)
0810 06:44:05.973318 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:05.973402 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
I20260810 06:44:06.035349 18653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:06.035104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:51253)
0810 06:44:06.035254 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:06.035291 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
I20260810 06:44:06.173033 18654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:06.172814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:35727)
0810 06:44:06.172956 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:06.172993 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":64,"threads_started":1}
I20260810 06:44:06.974170 18655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:06.973952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:58293)
0810 06:44:06.974086 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:06.974120 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
I20260810 06:44:07.036098 18656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:07.035784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:40083)
0810 06:44:07.036011 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:07.036060 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":60,"threads_started":1}
I20260810 06:44:07.173751 18657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:07.173552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:33439)
0810 06:44:07.173676 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:07.173708 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
I20260810 06:44:07.522845 18658 raft_consensus.cc:482] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:44:07.522945 18658 raft_consensus.cc:504] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:44:07.523149 18658 leader_election.cc:288] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813), f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271)
W20260810 06:44:07.523531 18086 leader_election.cc:341] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813): Not found: Tablet not found: 098cfb9d47ec435b9cf6f60e03d720d8
W20260810 06:44:07.523615 18083 leader_election.cc:341] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271): Not found: Tablet not found: 098cfb9d47ec435b9cf6f60e03d720d8
I20260810 06:44:07.523677 18083 leader_election.cc:302] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77fae6dce3e4d70960fde49d8a3a3e9; no voters: c35ef0117a064e1e9a7df7b8127b2f8a, f8fcce10b7104179a6be17c3a4159b31
I20260810 06:44:07.523763 18658 raft_consensus.cc:2726] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:44:07.974846 18659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:07.974606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:43531)
0810 06:44:07.974760 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:07.974800 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":66,"threads_started":1}
I20260810 06:44:08.036790 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:08.036576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:53969)
0810 06:44:08.036705 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:08.036744 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":61,"threads_started":1}
I20260810 06:44:08.174515 18661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:08.174295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:56915)
0810 06:44:08.174419 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:08.174470 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260810 06:44:08.975766 18664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:08.975493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:50781)
0810 06:44:08.975678 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:08.975716 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":108,"threads_started":1}
I20260810 06:44:09.037595 18665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:09.037327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:55755)
0810 06:44:09.037519 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:09.037555 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":78,"threads_started":1}
I20260810 06:44:09.175217 18666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:09.174974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:45569)
0810 06:44:09.175106 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:09.175163 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":64,"threads_started":1}
I20260810 06:44:09.976549 18667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:09.976311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:34635)
0810 06:44:09.976457 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:09.976497 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":65,"threads_started":1}
I20260810 06:44:10.038290 18671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:10.038051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:33797)
0810 06:44:10.038211 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:10.038247 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":97,"threads_started":1}
I20260810 06:44:10.175987 18673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:10.175770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:50473)
0810 06:44:10.175902 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:10.175941 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":62,"threads_started":1}
I20260810 06:44:10.977504 18674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:10.977222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:49255)
0810 06:44:10.977411 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:10.977456 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":68,"threads_started":1}
I20260810 06:44:11.038972 18675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:11.038752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:40975)
0810 06:44:11.038886 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:11.038925 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":60,"threads_started":1}
I20260810 06:44:11.076298 18676 raft_consensus.cc:482] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:44:11.076427 18676 raft_consensus.cc:504] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:44:11.076664 18676 leader_election.cc:288] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813), f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271)
W20260810 06:44:11.077064 18086 leader_election.cc:341] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813): Not found: Tablet not found: 098cfb9d47ec435b9cf6f60e03d720d8
W20260810 06:44:11.077175 18083 leader_election.cc:341] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271): Not found: Tablet not found: 098cfb9d47ec435b9cf6f60e03d720d8
I20260810 06:44:11.077255 18083 leader_election.cc:302] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77fae6dce3e4d70960fde49d8a3a3e9; no voters: c35ef0117a064e1e9a7df7b8127b2f8a, f8fcce10b7104179a6be17c3a4159b31
I20260810 06:44:11.077330 18676 raft_consensus.cc:2726] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:44:11.176738 18677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:11.176509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:57585)
0810 06:44:11.176657 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:11.176695 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":65,"threads_started":1}
I20260810 06:44:11.978332 18678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:11.978099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:52057)
0810 06:44:11.978243 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:11.978282 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":70,"threads_started":1}
I20260810 06:44:12.039749 18679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:12.039531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:60729)
0810 06:44:12.039670 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:12.039705 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":70,"threads_started":1}
I20260810 06:44:12.177445 18680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:12.177168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:57467)
0810 06:44:12.177321 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:12.177402 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":73,"threads_started":1}
I20260810 06:44:12.979053 18682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:12.978795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:59735)
0810 06:44:12.978970 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:12.979001 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":68,"threads_started":1}
I20260810 06:44:13.040625 18683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:13.040385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:43847)
0810 06:44:13.040534 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:13.040577 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":67,"threads_started":1}
I20260810 06:44:13.178151 18684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:13.177933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:41513)
0810 06:44:13.178080 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:13.178109 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":81,"threads_started":1}
I20260810 06:44:13.979874 18685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:13.979592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:36057)
0810 06:44:13.979786 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:13.979824 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":91,"threads_started":1}
I20260810 06:44:14.041514 18686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:14.041275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:37719)
0810 06:44:14.041431 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:14.041470 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":110,"threads_started":1}
I20260810 06:44:14.178884 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:14.178660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:37005)
0810 06:44:14.178791 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:14.178831 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":64,"threads_started":1}
I20260810 06:44:14.980588 18688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:14.980383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:45371)
0810 06:44:14.980505 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:14.980540 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":68,"threads_started":1}
I20260810 06:44:15.042152 18689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:15.041929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:34985)
0810 06:44:15.042073 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:15.042110 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
I20260810 06:44:15.179706 18690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:15.179498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:38353)
0810 06:44:15.179625 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:15.179663 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":63,"threads_started":1}
I20260810 06:44:15.654220 18691 raft_consensus.cc:482] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:44:15.654321 18691 raft_consensus.cc:504] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c35ef0117a064e1e9a7df7b8127b2f8a" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 33813 } } peers { permanent_uuid: "f8fcce10b7104179a6be17c3a4159b31" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46271 } } peers { permanent_uuid: "b77fae6dce3e4d70960fde49d8a3a3e9" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 37213 } }
I20260810 06:44:15.654542 18691 leader_election.cc:288] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813), f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271)
W20260810 06:44:15.655066 18086 leader_election.cc:341] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c35ef0117a064e1e9a7df7b8127b2f8a (127.27.41.130:33813): Not found: Tablet not found: 098cfb9d47ec435b9cf6f60e03d720d8
W20260810 06:44:15.655181 18083 leader_election.cc:341] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f8fcce10b7104179a6be17c3a4159b31 (127.27.41.131:46271): Not found: Tablet not found: 098cfb9d47ec435b9cf6f60e03d720d8
I20260810 06:44:15.655267 18083 leader_election.cc:302] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b77fae6dce3e4d70960fde49d8a3a3e9; no voters: c35ef0117a064e1e9a7df7b8127b2f8a, f8fcce10b7104179a6be17c3a4159b31
I20260810 06:44:15.655364 18691 raft_consensus.cc:2726] T 098cfb9d47ec435b9cf6f60e03d720d8 P b77fae6dce3e4d70960fde49d8a3a3e9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:44:15.981413 18692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:15.981114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:36947)
0810 06:44:15.981305 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:15.981364 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":133,"threads_started":1}
I20260810 06:44:16.042851 18693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:16.042624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:38615)
0810 06:44:16.042773 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:16.042809 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260810 06:44:16.180469 18694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:16.180244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:52379)
0810 06:44:16.180367 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:16.180402 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":63,"threads_started":1}
I20260810 06:44:16.982239 18696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:16.981971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.129:59157)
0810 06:44:16.982148 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:16.982187 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":85,"threads_started":1}
I20260810 06:44:17.043526 18698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:17.043333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.130:41701)
0810 06:44:17.043453 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:17.043484 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":65,"threads_started":1}
I20260810 06:44:17.178573 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 18012
I20260810 06:44:17.183609 18699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:17.183346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:45157 (local address 127.27.41.131:44911)
0810 06:44:17.183500 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:17.183535 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.190:45157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":56,"threads_started":1}
I20260810 06:44:17.189407 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 18253
I20260810 06:44:17.199654 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 18435
2026-08-10T06:44:17Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58675 ms)
[----------] 30 tests from SecurityITest (237130 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:17 dist-test-slave-bw88 krb5kdc[18702](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:17 dist-test-slave-bw88 krb5kdc[18702](info): set up 2 sockets
Aug 10 06:44:17 dist-test-slave-bw88 krb5kdc[18702](info): commencing operation
krb5kdc: starting...
W20260810 06:44:18.411116 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:18 dist-test-slave-bw88 krb5kdc[18702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:44:18.533416 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:41223
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:37379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:41223
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:18.615866 18719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:18.616119 18719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:18.616158 18719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:18.617271 18719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:18.617339 18719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:18.617381 18719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:18.617413 18719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:18.617436 18719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:18.618897 18719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:41223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:41223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:18.619184 18719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:18.619411 18719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:44:18.624922 18719 server_base.cc:1034] running on GCE node
W20260810 06:44:18.624903 18724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:18.624903 18728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:18.624888 18725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:18.625502 18719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:18.625818 18719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:18.627017 18719 hybrid_clock.cc:648] HybridClock initialized: now 1786344258627010 us; error 38 us; skew 500 ppm
Aug 10 06:44:18 dist-test-slave-bw88 krb5kdc[18702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344258, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:18.629778 18719 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:44:18.630232 18719 webserver.cc:460] Webserver started at http://127.27.41.190:36813/ using document root <none> and password file <none>
I20260810 06:44:18.630471 18719 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:18.630540 18719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:18.630692 18719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:18.631723 18719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "5f527a11e8c34f4195682b2ee04289ec"
format_stamp: "Formatted at 2026-08-10 06:44:18 on dist-test-slave-bw88"
server_key: "61e8211acfb52156b3bb60fe33daf478"
server_key_iv: "366567689c00161b1c2a0fa9cd097a16"
server_key_version: "encryptionkey@0"
I20260810 06:44:18.632099 18719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "5f527a11e8c34f4195682b2ee04289ec"
format_stamp: "Formatted at 2026-08-10 06:44:18 on dist-test-slave-bw88"
server_key: "61e8211acfb52156b3bb60fe33daf478"
server_key_iv: "366567689c00161b1c2a0fa9cd097a16"
server_key_version: "encryptionkey@0"
I20260810 06:44:18.633471 18719 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:44:18.634228 18738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:18.634398 18719 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:18.634527 18719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "5f527a11e8c34f4195682b2ee04289ec"
format_stamp: "Formatted at 2026-08-10 06:44:18 on dist-test-slave-bw88"
server_key: "61e8211acfb52156b3bb60fe33daf478"
server_key_iv: "366567689c00161b1c2a0fa9cd097a16"
server_key_version: "encryptionkey@0"
I20260810 06:44:18.634601 18719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:18.642486 18719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:18.644697 18719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:18.644853 18719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:18.649014 18719 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:41223
I20260810 06:44:18.649046 18818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:41223 every 8 connection(s)
I20260810 06:44:18.649458 18719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:18.650297 18820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:18.652637 18820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec: Bootstrap starting.
I20260810 06:44:18.653245 18820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:18.653563 18820 log.cc:824] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:18.654259 18820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec: No bootstrap required, opened a new log
I20260810 06:44:18.655975 18820 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f527a11e8c34f4195682b2ee04289ec" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41223 } }
I20260810 06:44:18.656113 18820 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:18.656136 18820 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f527a11e8c34f4195682b2ee04289ec, State: Initialized, Role: FOLLOWER
I20260810 06:44:18.656320 18820 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f527a11e8c34f4195682b2ee04289ec" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41223 } }
I20260810 06:44:18.656400 18820 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:18.656448 18820 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:18.656504 18820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:18.657022 18820 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f527a11e8c34f4195682b2ee04289ec" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41223 } }
I20260810 06:44:18.657131 18820 leader_election.cc:302] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f527a11e8c34f4195682b2ee04289ec; no voters:
I20260810 06:44:18.657313 18820 leader_election.cc:288] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:18.657399 18824 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:18.657574 18824 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [term 1 LEADER]: Becoming Leader. State: Replica: 5f527a11e8c34f4195682b2ee04289ec, State: Running, Role: LEADER
I20260810 06:44:18.657596 18820 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:18.657691 18824 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f527a11e8c34f4195682b2ee04289ec" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41223 } }
I20260810 06:44:18.658244 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 18719
I20260810 06:44:18.658244 18826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f527a11e8c34f4195682b2ee04289ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f527a11e8c34f4195682b2ee04289ec" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41223 } } }
I20260810 06:44:18.658324 18826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:18.658345 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:18.658589 27814 external_mini_cluster.cc:1428] Setting key 4bc20b30e59f0b7c99914ad419f0de52
I20260810 06:44:18.659206 18827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f527a11e8c34f4195682b2ee04289ec. Latest consensus state: current_term: 1 leader_uuid: "5f527a11e8c34f4195682b2ee04289ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f527a11e8c34f4195682b2ee04289ec" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 41223 } } }
I20260810 06:44:18.659303 18827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec [sys.catalog]: This master's current role is: LEADER
W20260810 06:44:18.659705 18852 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:44:18.659780 18852 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:44:18.659865 18835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:18.660049 18835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:18.661701 18835 catalog_manager.cc:1347] Generated new cluster ID: c7fc4290d25b42f7adfd36e87f2ffed7
I20260810 06:44:18.661752 18835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:44:18 dist-test-slave-bw88 krb5kdc[18702](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:18.670761 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:18.659137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43594 (local address 127.27.41.190:41223)
0810 06:44:18.659295 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:18.659304 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:18.659525 (+ 221us) server_negotiation.cc:407] Connection header received
0810 06:44:18.659661 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:18.659668 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:18.659738 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:18.659876 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:18.660588 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:18.661891 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:18.662986 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:18.663584 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:18.663687 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:18.666472 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:18.666476 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:18.666477 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:18.666489 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:18.669084 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:18.669478 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:18.669481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:18.669482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:18.669603 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:18.669818 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:18.669819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:18.669820 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:18.670140 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:18.670301 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:18.670369 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 06:44:18.670532 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":90,"threads_started":1}
I20260810 06:44:18.676749 18835 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:18.677450 18835 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:18.682991 18835 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec: Generated new TSK 0
I20260810 06:44:18.683141 18835 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:44:18.711966 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:41223
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:37379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:18.794185 18863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:18.794376 18863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:18.794400 18863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:18.795452 18863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:18.795491 18863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:18.795517 18863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:44:18.796967 18863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:41223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:18.797145 18863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:18.797308 18863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:18.802282 18877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:18.802294 18870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:18.802284 18873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:18.802462 18863 server_base.cc:1034] running on GCE node
I20260810 06:44:18.802798 18863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:18.802997 18863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:18.804137 18863 hybrid_clock.cc:648] HybridClock initialized: now 1786344258804125 us; error 35 us; skew 500 ppm
Aug 10 06:44:18 dist-test-slave-bw88 krb5kdc[18702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344258, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:18.806792 18863 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:44:18.807202 18863 webserver.cc:460] Webserver started at http://127.27.41.129:40741/ using document root <none> and password file <none>
I20260810 06:44:18.807418 18863 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:18.807508 18863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:18.807662 18863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:18.808633 18863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "0aaebc3b86b947dca12ac3c158b5d01a"
format_stamp: "Formatted at 2026-08-10 06:44:18 on dist-test-slave-bw88"
server_key: "4384e90323d1753168c52b06d0dc74a7"
server_key_iv: "abca3aabad16d032ed5c77a25e4c3625"
server_key_version: "encryptionkey@0"
I20260810 06:44:18.808982 18863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "0aaebc3b86b947dca12ac3c158b5d01a"
format_stamp: "Formatted at 2026-08-10 06:44:18 on dist-test-slave-bw88"
server_key: "4384e90323d1753168c52b06d0dc74a7"
server_key_iv: "abca3aabad16d032ed5c77a25e4c3625"
server_key_version: "encryptionkey@0"
I20260810 06:44:18.810333 18863 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:44:18.811048 18891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:18.811214 18863 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:18.811316 18863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "0aaebc3b86b947dca12ac3c158b5d01a"
format_stamp: "Formatted at 2026-08-10 06:44:18 on dist-test-slave-bw88"
server_key: "4384e90323d1753168c52b06d0dc74a7"
server_key_iv: "abca3aabad16d032ed5c77a25e4c3625"
server_key_version: "encryptionkey@0"
I20260810 06:44:18.811396 18863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:18.831163 18863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:18.832935 18863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:18.833105 18863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:18.833410 18863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:18.833745 18863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:18.833802 18863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:18.833845 18863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:18.833871 18863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:18.839921 18863 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:38537
I20260810 06:44:18.840003 19059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:38537 every 8 connection(s)
I20260810 06:44:18.840327 18863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
Aug 10 06:44:18 dist-test-slave-bw88 krb5kdc[18702](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344258, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:18.846951 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 18863
I20260810 06:44:18.847111 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:44:18.847304 27814 external_mini_cluster.cc:1428] Setting key 69aec32909fb5f1b42ef012cfaf65e8d
I20260810 06:44:18.849233 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:18.841022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:37377 (local address 127.27.41.190:41223)
0810 06:44:18.841068 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:18.841070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:18.841290 (+ 220us) server_negotiation.cc:407] Connection header received
0810 06:44:18.841784 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:18.841785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:18.841795 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:18.841855 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:18.842733 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:18.843223 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:18.844194 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:18.844387 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:18.844440 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:18.846395 (+ 1955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:18.846396 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:18.846397 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:18.846403 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:18.847843 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:18.848274 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:18.848275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:18.848276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:18.848337 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:18.848602 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:18.848604 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:18.848604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:18.848718 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:18.848789 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:18.849065 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 06:44:18.849149 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:44:18.849414 19064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:18.840967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:41223 (local address 127.27.41.129:37377)
0810 06:44:18.841121 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:18.841167 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:18.841698 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:18.841906 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:18.841909 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:18.842469 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:18.842653 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:18.842658 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:18.843301 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:18.843302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:18.844116 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:18.844118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:18.844460 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:18.844461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:18.844556 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:18.844977 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:18.844985 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:18.846315 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:18.847946 (+ 1631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:18.847955 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:18.847957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:18.848181 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:18.848410 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:18.848411 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:18.848411 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:18.848533 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:18.848791 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:18.848799 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:18.848929 (+ 130us) client_negotiation.cc:769] Sending connection context
0810 06:44:18.849028 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 06:44:18.849177 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
I20260810 06:44:18.850049 19062 heartbeater.cc:347] Connected to a master server at 127.27.41.190:41223
I20260810 06:44:18.850144 19062 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:18.850312 19062 heartbeater.cc:511] Master 127.27.41.190:41223 requested a full tablet report, sending...
I20260810 06:44:18.850821 18764 ts_manager.cc:194] Registered new tserver with Master: 0aaebc3b86b947dca12ac3c158b5d01a (127.27.41.129:38537)
I20260810 06:44:18.851704 18764 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:37377
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:44:18.873868 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:41223
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:37379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:18.954628 19067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:18.954820 19067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:18.954843 19067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:18.955897 19067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:18.955932 19067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:18.955956 19067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:44:18.957314 19067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:41223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:18.957559 19067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:18.957746 19067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:18.962939 19076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:18.962970 19072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:18.962998 19067 server_base.cc:1034] running on GCE node
W20260810 06:44:18.963069 19074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:18.963392 19067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:18.963631 19067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:18.964771 19067 hybrid_clock.cc:648] HybridClock initialized: now 1786344258964751 us; error 38 us; skew 500 ppm
Aug 10 06:44:18 dist-test-slave-bw88 krb5kdc[18702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344258, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:18.967439 19067 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:44:18.967902 19067 webserver.cc:460] Webserver started at http://127.27.41.130:42323/ using document root <none> and password file <none>
I20260810 06:44:18.968138 19067 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:18.968183 19067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:18.968336 19067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:18.969321 19067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "0a10a3fb00a74c348b224ae021309563"
format_stamp: "Formatted at 2026-08-10 06:44:18 on dist-test-slave-bw88"
server_key: "f1d08ca2d88a6a188a48433ae5dc90f9"
server_key_iv: "1e2bb18429ed291b29cac971c3e352fb"
server_key_version: "encryptionkey@0"
I20260810 06:44:18.969743 19067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "0a10a3fb00a74c348b224ae021309563"
format_stamp: "Formatted at 2026-08-10 06:44:18 on dist-test-slave-bw88"
server_key: "f1d08ca2d88a6a188a48433ae5dc90f9"
server_key_iv: "1e2bb18429ed291b29cac971c3e352fb"
server_key_version: "encryptionkey@0"
I20260810 06:44:18.971087 19067 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:44:18.971807 19085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:18.972000 19067 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:18.972093 19067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "0a10a3fb00a74c348b224ae021309563"
format_stamp: "Formatted at 2026-08-10 06:44:18 on dist-test-slave-bw88"
server_key: "f1d08ca2d88a6a188a48433ae5dc90f9"
server_key_iv: "1e2bb18429ed291b29cac971c3e352fb"
server_key_version: "encryptionkey@0"
I20260810 06:44:18.972162 19067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:18.998483 19067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:19.000439 19067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:19.000602 19067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:19.000821 19067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:19.001137 19067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:19.001204 19067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.001238 19067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:19.001266 19067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.007156 19067 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:41153
I20260810 06:44:19.007213 19245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:41153 every 8 connection(s)
I20260810 06:44:19.007530 19067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:44:19.008706 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 19067
I20260810 06:44:19.008843 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:44:19.009081 27814 external_mini_cluster.cc:1428] Setting key dbfaa688f2a04032a0626910cff6bad3
Aug 10 06:44:19 dist-test-slave-bw88 krb5kdc[18702](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344258, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:19.018174 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.008224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:56691 (local address 127.27.41.190:41223)
0810 06:44:19.008267 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:19.008270 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:19.008458 (+ 188us) server_negotiation.cc:407] Connection header received
0810 06:44:19.009005 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:19.009007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:19.009021 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:19.009104 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:19.010226 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.010985 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.012268 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.012459 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.012516 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.015215 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:19.015217 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:19.015217 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:19.015224 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:19.016667 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:19.017145 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:19.017146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:19.017146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:19.017206 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:19.017548 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:19.017549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:19.017549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:19.017645 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:19.017715 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:19.018043 (+ 328us) server_negotiation.cc:299] Negotiation successful
0810 06:44:19.018112 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:44:19.018489 19249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.008178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:41223 (local address 127.27.41.130:56691)
0810 06:44:19.008334 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:19.008372 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:19.008889 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:19.009176 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:19.009181 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:19.009912 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:19.010131 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.010136 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.011081 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.011082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.012175 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.012179 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.012550 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.012551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.012705 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.013260 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:19.013268 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:19.015067 (+ 1799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:19.016751 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:19.016759 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:19.016761 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:19.017073 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:19.017297 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:19.017298 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:19.017298 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:19.017469 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:19.017730 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:19.017738 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:19.017904 (+ 166us) client_negotiation.cc:769] Sending connection context
0810 06:44:19.018015 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 06:44:19.018187 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":88,"threads_started":1}
I20260810 06:44:19.019032 19247 heartbeater.cc:347] Connected to a master server at 127.27.41.190:41223
I20260810 06:44:19.019120 19247 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
I20260810 06:44:19.019294 19247 heartbeater.cc:511] Master 127.27.41.190:41223 requested a full tablet report, sending...
I20260810 06:44:19.019668 18764 ts_manager.cc:194] Registered new tserver with Master: 0a10a3fb00a74c348b224ae021309563 (127.27.41.130:41153)
I20260810 06:44:19.019996 18764 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:56691
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:44:19.035986 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:41223
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:37379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:19.122642 19257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:19.122880 19257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:19.122920 19257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:19.124097 19257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:19.124177 19257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:19.124228 19257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:44:19.125857 19257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:41223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:19.126117 19257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:19.126374 19257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:19.131839 19270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:19.131863 19267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:19.131947 19266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:19.131935 19257 server_base.cc:1034] running on GCE node
I20260810 06:44:19.132258 19257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:19.132530 19257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:19.133684 19257 hybrid_clock.cc:648] HybridClock initialized: now 1786344259133672 us; error 29 us; skew 500 ppm
Aug 10 06:44:19 dist-test-slave-bw88 krb5kdc[18702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344259, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:19.136270 19257 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:44:19.136736 19257 webserver.cc:460] Webserver started at http://127.27.41.131:46577/ using document root <none> and password file <none>
I20260810 06:44:19.136929 19257 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:19.136969 19257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:19.137071 19257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:19.138082 19257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "54f92239b6c74ca48c9bd287774867cc"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "62ed733d1659f01d5adb1977e80b6e85"
server_key_iv: "88504cf1ccb515e1cf8d23ad1f4c6ff6"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.138381 19257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "54f92239b6c74ca48c9bd287774867cc"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "62ed733d1659f01d5adb1977e80b6e85"
server_key_iv: "88504cf1ccb515e1cf8d23ad1f4c6ff6"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.139714 19257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:44:19.140432 19277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.140628 19257 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:44:19.140702 19257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "54f92239b6c74ca48c9bd287774867cc"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "62ed733d1659f01d5adb1977e80b6e85"
server_key_iv: "88504cf1ccb515e1cf8d23ad1f4c6ff6"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.140753 19257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:19.166738 19257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:19.169137 19257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:19.169256 19257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:19.169507 19257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:19.169891 19257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:19.169948 19257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.169993 19257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:19.170017 19257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.176499 19257 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:42841
I20260810 06:44:19.176549 19458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:42841 every 8 connection(s)
I20260810 06:44:19.176872 19257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:44:19.180934 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 19257
I20260810 06:44:19.181032 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:44:19.181295 27814 external_mini_cluster.cc:1428] Setting key 48c759173c73da3770f1335dc22144af
Aug 10 06:44:19 dist-test-slave-bw88 krb5kdc[18702](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344259, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:19.186304 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.177627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:51533 (local address 127.27.41.190:41223)
0810 06:44:19.177686 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:19.177688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:19.177911 (+ 223us) server_negotiation.cc:407] Connection header received
0810 06:44:19.178416 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:19.178417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:19.178428 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:19.178483 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:19.179380 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.179873 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.180892 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.181172 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.181222 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.183739 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:19.183741 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:19.183741 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:19.183747 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:19.185166 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:19.185593 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:19.185594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:19.185594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:19.185648 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:19.185856 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:19.185856 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:19.185856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:19.185948 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:19.185993 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:19.186183 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 06:44:19.186243 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 06:44:19.186542 19463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.177617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:41223 (local address 127.27.41.131:51533)
0810 06:44:19.177769 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:19.177806 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:19.178336 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:19.178537 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:19.178541 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:19.179107 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:19.179304 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.179308 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.179949 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.179950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.180800 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.180804 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.181265 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.181266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.181450 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.182054 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:19.182064 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:19.183657 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:19.185235 (+ 1578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:19.185240 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:19.185242 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:19.185518 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:19.185709 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:19.185710 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:19.185710 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:19.185807 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:19.185982 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:19.185985 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:19.186098 (+ 113us) client_negotiation.cc:769] Sending connection context
0810 06:44:19.186171 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 06:44:19.186285 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
I20260810 06:44:19.187084 19459 heartbeater.cc:347] Connected to a master server at 127.27.41.190:41223
I20260810 06:44:19.187191 19459 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:19.187364 19459 heartbeater.cc:511] Master 127.27.41.190:41223 requested a full tablet report, sending...
I20260810 06:44:19.187742 18764 ts_manager.cc:194] Registered new tserver with Master: 54f92239b6c74ca48c9bd287774867cc (127.27.41.131:42841)
I20260810 06:44:19.188114 18764 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:51533
I20260810 06:44:19.192914 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:44:19.200093 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.194334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43600 (local address 127.27.41.190:41223)
0810 06:44:19.194387 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:19.194389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:19.194483 (+ 94us) server_negotiation.cc:407] Connection header received
0810 06:44:19.194525 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:19.194525 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:19.194534 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:19.194606 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:19.195111 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.195559 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.196282 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.196461 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.196514 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.197666 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:19.197667 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:19.197667 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:19.197673 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:19.199206 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:19.199493 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:19.199494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:19.199494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:19.199546 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:19.199696 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:19.199696 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:19.199697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:19.199821 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:19.199890 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:19.199974 (+ 84us) server_negotiation.cc:299] Negotiation successful
0810 06:44:19.200030 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 06:44:19.201622 18764 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43600:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:44:19.203220 18764 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:44:19.209847 19478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.205597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:42841 (local address 127.0.0.1:36994)
0810 06:44:19.205911 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:19.205935 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:19.205997 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:19.206273 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:19.206276 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:19.206278 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:19.206364 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.206366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.207337 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.207338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.208598 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.208601 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.209576 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.209577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.209666 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.209680 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 06:44:19.209725 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 06:44:19.209773 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":52,"threads_started":1}
I20260810 06:44:19.209950 19476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.205788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:38537 (local address 127.0.0.1:44028)
0810 06:44:19.205979 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:19.205989 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:19.206030 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:19.206368 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:19.206368 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:19.206370 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:19.206436 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.206437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.207823 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.207824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.208903 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.208906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.209661 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.209663 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.209731 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.209735 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:44:19.209820 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 06:44:19.209869 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":7,"thread_start_us":77,"threads_started":1}
I20260810 06:44:19.210273 19477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.205687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36994 (local address 127.27.41.131:42841)
0810 06:44:19.206075 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:19.206081 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:19.206093 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:44:19.206135 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:19.206138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:19.206153 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:19.206242 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:19.206447 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.207230 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.208698 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.209465 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.209957 (+ 492us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.210022 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:19.210142 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 06:44:19.210186 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":106,"threads_started":1}
I20260810 06:44:19.210426 19483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.206010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44028 (local address 127.27.41.129:38537)
0810 06:44:19.206205 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:19.206208 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:19.206219 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:44:19.206258 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:19.206259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:19.206274 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:19.206511 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:19.206591 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.207704 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.208995 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.209561 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.209647 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.209708 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:19.209840 (+ 132us) server_negotiation.cc:299] Negotiation successful
0810 06:44:19.209878 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":111,"threads_started":1}
I20260810 06:44:19.210960 19360 tablet_service.cc:1467] Processing CreateTablet for tablet 95e6a53b0b84496d83c919c99ed3d037 (DEFAULT_TABLE table=test-table [id=e55fd3b350ee4d3ab9e50b9fbb930ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:19.211133 18961 tablet_service.cc:1467] Processing CreateTablet for tablet 95e6a53b0b84496d83c919c99ed3d037 (DEFAULT_TABLE table=test-table [id=e55fd3b350ee4d3ab9e50b9fbb930ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:19.211295 19475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.205595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:41153 (local address 127.0.0.1:49420)
0810 06:44:19.205749 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:19.205789 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:19.205853 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:19.206364 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:19.206365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:19.206367 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:19.206441 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.206442 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.209012 (+ 2570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.209013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.210069 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.210073 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.211060 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.211062 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.211132 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.211136 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:44:19.211189 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 06:44:19.211227 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":3,"thread_start_us":87,"threads_started":1}
I20260810 06:44:19.211376 19360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95e6a53b0b84496d83c919c99ed3d037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:19.211524 18961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95e6a53b0b84496d83c919c99ed3d037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:19.211598 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.205809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49420 (local address 127.27.41.130:41153)
0810 06:44:19.206118 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:19.206123 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:19.206134 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:44:19.206176 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:19.206178 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:19.206194 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:19.206276 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:19.206524 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.207698 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.210167 (+ 2469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.210882 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.210956 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.211010 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:19.211465 (+ 455us) server_negotiation.cc:299] Negotiation successful
0810 06:44:19.211516 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":76,"threads_started":1}
I20260810 06:44:19.212224 19152 tablet_service.cc:1467] Processing CreateTablet for tablet 95e6a53b0b84496d83c919c99ed3d037 (DEFAULT_TABLE table=test-table [id=e55fd3b350ee4d3ab9e50b9fbb930ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:19.212527 19152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95e6a53b0b84496d83c919c99ed3d037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:19.214375 19484 tablet_bootstrap.cc:492] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc: Bootstrap starting.
I20260810 06:44:19.215137 19487 tablet_bootstrap.cc:492] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a: Bootstrap starting.
I20260810 06:44:19.215305 19484 tablet_bootstrap.cc:654] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:19.215938 19487 tablet_bootstrap.cc:654] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:19.215938 19484 log.cc:824] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:19.215935 19488 tablet_bootstrap.cc:492] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563: Bootstrap starting.
I20260810 06:44:19.216488 19487 log.cc:824] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:19.216717 19488 tablet_bootstrap.cc:654] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:19.216866 19484 tablet_bootstrap.cc:492] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc: No bootstrap required, opened a new log
I20260810 06:44:19.216939 19484 ts_tablet_manager.cc:1397] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:44:19.217367 19487 tablet_bootstrap.cc:492] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a: No bootstrap required, opened a new log
I20260810 06:44:19.217437 19488 log.cc:824] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:19.217497 19487 ts_tablet_manager.cc:1397] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:44:19.218163 19488 tablet_bootstrap.cc:492] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563: No bootstrap required, opened a new log
I20260810 06:44:19.218245 19488 ts_tablet_manager.cc:1397] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 06:44:19.219062 19484 raft_consensus.cc:348] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a10a3fb00a74c348b224ae021309563" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 41153 } } peers { permanent_uuid: "0aaebc3b86b947dca12ac3c158b5d01a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38537 } } peers { permanent_uuid: "54f92239b6c74ca48c9bd287774867cc" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 42841 } }
I20260810 06:44:19.219250 19484 raft_consensus.cc:374] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:19.219287 19484 raft_consensus.cc:729] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f92239b6c74ca48c9bd287774867cc, State: Initialized, Role: FOLLOWER
I20260810 06:44:19.219429 19484 consensus_queue.cc:260] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a10a3fb00a74c348b224ae021309563" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 41153 } } peers { permanent_uuid: "0aaebc3b86b947dca12ac3c158b5d01a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38537 } } peers { permanent_uuid: "54f92239b6c74ca48c9bd287774867cc" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 42841 } }
I20260810 06:44:19.219470 19487 raft_consensus.cc:348] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a10a3fb00a74c348b224ae021309563" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 41153 } } peers { permanent_uuid: "0aaebc3b86b947dca12ac3c158b5d01a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38537 } } peers { permanent_uuid: "54f92239b6c74ca48c9bd287774867cc" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 42841 } }
I20260810 06:44:19.219655 19487 raft_consensus.cc:374] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:19.219704 19487 raft_consensus.cc:729] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aaebc3b86b947dca12ac3c158b5d01a, State: Initialized, Role: FOLLOWER
I20260810 06:44:19.219749 19484 ts_tablet_manager.cc:1428] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:44:19.219885 19459 heartbeater.cc:503] Master 127.27.41.190:41223 was elected leader, sending a full tablet report...
I20260810 06:44:19.219864 19487 consensus_queue.cc:260] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a10a3fb00a74c348b224ae021309563" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 41153 } } peers { permanent_uuid: "0aaebc3b86b947dca12ac3c158b5d01a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38537 } } peers { permanent_uuid: "54f92239b6c74ca48c9bd287774867cc" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 42841 } }
I20260810 06:44:19.219851 19488 raft_consensus.cc:348] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a10a3fb00a74c348b224ae021309563" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 41153 } } peers { permanent_uuid: "0aaebc3b86b947dca12ac3c158b5d01a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38537 } } peers { permanent_uuid: "54f92239b6c74ca48c9bd287774867cc" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 42841 } }
I20260810 06:44:19.220033 19488 raft_consensus.cc:374] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:19.220079 19488 raft_consensus.cc:729] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a10a3fb00a74c348b224ae021309563, State: Initialized, Role: FOLLOWER
I20260810 06:44:19.220157 19487 ts_tablet_manager.cc:1428] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:44:19.220270 19062 heartbeater.cc:503] Master 127.27.41.190:41223 was elected leader, sending a full tablet report...
I20260810 06:44:19.220552 19488 consensus_queue.cc:260] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a10a3fb00a74c348b224ae021309563" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 41153 } } peers { permanent_uuid: "0aaebc3b86b947dca12ac3c158b5d01a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38537 } } peers { permanent_uuid: "54f92239b6c74ca48c9bd287774867cc" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 42841 } }
I20260810 06:44:19.220851 19488 ts_tablet_manager.cc:1428] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 06:44:19.220979 19247 heartbeater.cc:503] Master 127.27.41.190:41223 was elected leader, sending a full tablet report...
W20260810 06:44:19.258066 19248 tablet.cc:2369] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:44:19.291983 19493 raft_consensus.cc:482] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:44:19.292098 19493 raft_consensus.cc:504] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a10a3fb00a74c348b224ae021309563" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 41153 } } peers { permanent_uuid: "0aaebc3b86b947dca12ac3c158b5d01a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38537 } } peers { permanent_uuid: "54f92239b6c74ca48c9bd287774867cc" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 42841 } }
I20260810 06:44:19.292495 19493 leader_election.cc:288] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a10a3fb00a74c348b224ae021309563 (127.27.41.130:41153), 0aaebc3b86b947dca12ac3c158b5d01a (127.27.41.129:38537)
I20260810 06:44:19.295558 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.292747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:57571 (local address 127.27.41.130:41153)
0810 06:44:19.292800 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:19.292802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:19.292816 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:44:19.292923 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:19.292924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:19.292938 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:19.292991 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:19.293198 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.293761 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.294798 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.295210 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.295266 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.295273 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:19.295454 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 06:44:19.295491 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 06:44:19.295544 19463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.292650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:41153 (local address 127.27.41.131:57571)
0810 06:44:19.292749 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:19.292779 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:19.292837 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:19.293019 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:19.293020 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:19.293022 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:19.293105 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.293133 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.293839 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.293840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.294705 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.294708 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.295292 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.295293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.295374 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.295378 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:44:19.295431 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 06:44:19.295473 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"mutex_wait_us":31}
I20260810 06:44:19.295749 19483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.292911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:48065 (local address 127.27.41.129:38537)
0810 06:44:19.292979 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:19.292981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:19.293090 (+ 109us) server_negotiation.cc:407] Connection header received
0810 06:44:19.293150 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:19.293151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:19.293160 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:19.293207 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:19.293389 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.293876 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.294929 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.295365 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.295439 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.295447 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:19.295618 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 06:44:19.295665 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 06:44:19.295761 19497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.292800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:38537 (local address 127.27.41.131:48065)
0810 06:44:19.292986 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:19.292995 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:19.293093 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:19.293230 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:19.293230 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:19.293232 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:19.293302 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.293303 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.293960 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.293961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.294844 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.294847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.295459 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.295461 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.295527 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.295531 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:44:19.295598 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 06:44:19.295684 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":134,"threads_started":1}
I20260810 06:44:19.295876 19177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e6a53b0b84496d83c919c99ed3d037" candidate_uuid: "54f92239b6c74ca48c9bd287774867cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a10a3fb00a74c348b224ae021309563" is_pre_election: true
I20260810 06:44:19.296053 19177 raft_consensus.cc:2454] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f92239b6c74ca48c9bd287774867cc in term 0.
I20260810 06:44:19.296089 18993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e6a53b0b84496d83c919c99ed3d037" candidate_uuid: "54f92239b6c74ca48c9bd287774867cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aaebc3b86b947dca12ac3c158b5d01a" is_pre_election: true
I20260810 06:44:19.296254 18993 raft_consensus.cc:2454] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54f92239b6c74ca48c9bd287774867cc in term 0.
I20260810 06:44:19.296259 19279 leader_election.cc:302] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a10a3fb00a74c348b224ae021309563, 54f92239b6c74ca48c9bd287774867cc; no voters:
I20260810 06:44:19.296376 19493 raft_consensus.cc:2781] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:44:19.296427 19493 raft_consensus.cc:482] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:44:19.296443 19493 raft_consensus.cc:3037] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:19.297223 19493 raft_consensus.cc:504] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a10a3fb00a74c348b224ae021309563" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 41153 } } peers { permanent_uuid: "0aaebc3b86b947dca12ac3c158b5d01a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38537 } } peers { permanent_uuid: "54f92239b6c74ca48c9bd287774867cc" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 42841 } }
I20260810 06:44:19.297406 19493 leader_election.cc:288] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [CANDIDATE]: Term 1 election: Requested vote from peers 0a10a3fb00a74c348b224ae021309563 (127.27.41.130:41153), 0aaebc3b86b947dca12ac3c158b5d01a (127.27.41.129:38537)
I20260810 06:44:19.297580 19177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e6a53b0b84496d83c919c99ed3d037" candidate_uuid: "54f92239b6c74ca48c9bd287774867cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a10a3fb00a74c348b224ae021309563"
I20260810 06:44:19.297641 18993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e6a53b0b84496d83c919c99ed3d037" candidate_uuid: "54f92239b6c74ca48c9bd287774867cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aaebc3b86b947dca12ac3c158b5d01a"
I20260810 06:44:19.297686 19177 raft_consensus.cc:3037] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:19.297701 18993 raft_consensus.cc:3037] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:19.298606 18993 raft_consensus.cc:2454] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f92239b6c74ca48c9bd287774867cc in term 1.
I20260810 06:44:19.298606 19177 raft_consensus.cc:2454] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54f92239b6c74ca48c9bd287774867cc in term 1.
I20260810 06:44:19.298772 19279 leader_election.cc:302] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aaebc3b86b947dca12ac3c158b5d01a, 54f92239b6c74ca48c9bd287774867cc; no voters:
I20260810 06:44:19.298863 19493 raft_consensus.cc:2781] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:19.299007 19493 raft_consensus.cc:686] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [term 1 LEADER]: Becoming Leader. State: Replica: 54f92239b6c74ca48c9bd287774867cc, State: Running, Role: LEADER
I20260810 06:44:19.299108 19493 consensus_queue.cc:237] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a10a3fb00a74c348b224ae021309563" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 41153 } } peers { permanent_uuid: "0aaebc3b86b947dca12ac3c158b5d01a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38537 } } peers { permanent_uuid: "54f92239b6c74ca48c9bd287774867cc" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 42841 } }
I20260810 06:44:19.299854 18764 catalog_manager.cc:5495] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 54f92239b6c74ca48c9bd287774867cc (127.27.41.131). New cstate: current_term: 1 leader_uuid: "54f92239b6c74ca48c9bd287774867cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a10a3fb00a74c348b224ae021309563" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 41153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aaebc3b86b947dca12ac3c158b5d01a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54f92239b6c74ca48c9bd287774867cc" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 42841 } health_report { overall_health: HEALTHY } } }
I20260810 06:44:19.324965 19477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.322675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37006 (local address 127.27.41.131:42841)
0810 06:44:19.322737 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:19.322739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:19.322748 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:44:19.322800 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:19.322801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:19.322816 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:19.322903 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:19.323052 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.323484 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.324220 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.324400 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.324472 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.324644 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:19.324734 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:19.324827 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:19.324845 (+ 18us) server_negotiation.cc:299] Negotiation successful
0810 06:44:19.324865 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 06:44:19.326771 19177 raft_consensus.cc:1261] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563 [term 1 FOLLOWER]: Refusing update from remote peer 54f92239b6c74ca48c9bd287774867cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:19.326787 18993 raft_consensus.cc:1261] T 95e6a53b0b84496d83c919c99ed3d037 P 0aaebc3b86b947dca12ac3c158b5d01a [term 1 FOLLOWER]: Refusing update from remote peer 54f92239b6c74ca48c9bd287774867cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:19.327122 19498 consensus_queue.cc:1035] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a10a3fb00a74c348b224ae021309563" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 41153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:19.327231 19493 consensus_queue.cc:1035] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aaebc3b86b947dca12ac3c158b5d01a" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:19.330405 19503 mvcc.cc:205] Tried to move back new op lower bound from 7316866086199828480 to 7316866086089728000. Current Snapshot: MvccSnapshot[applied={T|T < 7316866086199828480 or (T in {7316866086199828480})}]
I20260810 06:44:19.330533 19504 mvcc.cc:205] Tried to move back new op lower bound from 7316866086199828480 to 7316866086089728000. Current Snapshot: MvccSnapshot[applied={T|T < 7316866086199828480}]
I20260810 06:44:19.332058 18764 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:44:19.332154 18764 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:44:19.332860 18764 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5f527a11e8c34f4195682b2ee04289ec: Sending DeleteTablet for 3 replicas of tablet 95e6a53b0b84496d83c919c99ed3d037
I20260810 06:44:19.333196 19360 tablet_service.cc:1514] Processing DeleteTablet for tablet 95e6a53b0b84496d83c919c99ed3d037 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:19 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:36994
I20260810 06:44:19.333241 19152 tablet_service.cc:1514] Processing DeleteTablet for tablet 95e6a53b0b84496d83c919c99ed3d037 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:19 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:49420
I20260810 06:44:19.333263 18961 tablet_service.cc:1514] Processing DeleteTablet for tablet 95e6a53b0b84496d83c919c99ed3d037 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:19 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:44028
I20260810 06:44:19.333439 19519 tablet_replica.cc:330] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc: stopping tablet replica
I20260810 06:44:19.333523 19519 raft_consensus.cc:2229] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:44:19.333647 19519 raft_consensus.cc:2258] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:44:19.333782 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 18863
I20260810 06:44:19.336197 19519 ts_tablet_manager.cc:1905] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:44:19.337991 19519 ts_tablet_manager.cc:1918] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:44:19.338068 19519 log.cc:1196] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/95e6a53b0b84496d83c919c99ed3d037
I20260810 06:44:19.338666 19519 ts_tablet_manager.cc:1939] T 95e6a53b0b84496d83c919c99ed3d037 P 54f92239b6c74ca48c9bd287774867cc: Deleting consensus metadata
I20260810 06:44:19.340987 18744 catalog_manager.cc:4841] TS 54f92239b6c74ca48c9bd287774867cc (127.27.41.131:42841): tablet 95e6a53b0b84496d83c919c99ed3d037 (table test-table [id=e55fd3b350ee4d3ab9e50b9fbb930ee1]) successfully deleted
I20260810 06:44:19.342214 19521 tablet_replica.cc:330] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563: stopping tablet replica
I20260810 06:44:19.342370 19521 raft_consensus.cc:2229] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:44:19.342530 19521 raft_consensus.cc:2258] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:44:19.343034 19521 ts_tablet_manager.cc:1905] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:44:19.345208 19521 ts_tablet_manager.cc:1918] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:44:19.345338 19521 log.cc:1196] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/95e6a53b0b84496d83c919c99ed3d037
I20260810 06:44:19.345713 19521 ts_tablet_manager.cc:1939] T 95e6a53b0b84496d83c919c99ed3d037 P 0a10a3fb00a74c348b224ae021309563: Deleting consensus metadata
I20260810 06:44:19.346163 18742 catalog_manager.cc:4841] TS 0a10a3fb00a74c348b224ae021309563 (127.27.41.130:41153): tablet 95e6a53b0b84496d83c919c99ed3d037 (table test-table [id=e55fd3b350ee4d3ab9e50b9fbb930ee1]) successfully deleted
W20260810 06:44:19.349135 18742 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:38537 (error 108)
I20260810 06:44:19.349712 19475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.349571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:38537 (local address 127.0.0.1:44044)
0810 06:44:19.349636 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:19.349681 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:38537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 06:44:19.349840 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 19067
W20260810 06:44:19.349835 18742 catalog_manager.cc:4584] TS 0aaebc3b86b947dca12ac3c158b5d01a (127.27.41.129:38537): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 95e6a53b0b84496d83c919c99ed3d037: Network error: Client connection negotiation failed: client connection to 127.27.41.129:38537: connect: Connection refused (error 111)
I20260810 06:44:19.364724 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 19257
I20260810 06:44:19.374312 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 18719
2026-08-10T06:44:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2172 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-10T06:44:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:19Z Disabled control of system clock
I20260810 06:44:19.406551 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:43549
--webserver_interface=127.27.41.190
--webserver_port=0
--builtin_ntp_servers=127.27.41.148:37533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:43549
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 06:44:19.488054 19527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:19.488389 19527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:19.488440 19527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:19.490357 19527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:19.490402 19527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:19.490415 19527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:19.490428 19527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:19.490442 19527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:19.491729 19527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:43549
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:43549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:19.491915 19527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:19.492146 19527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:19.497074 19533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:19.497095 19532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:19.497131 19527 server_base.cc:1034] running on GCE node
W20260810 06:44:19.497066 19535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:19.497503 19527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:19.497800 19527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:19.498950 19527 hybrid_clock.cc:648] HybridClock initialized: now 1786344259498928 us; error 37 us; skew 500 ppm
I20260810 06:44:19.500233 19527 webserver.cc:460] Webserver started at http://127.27.41.190:33273/ using document root <none> and password file <none>
I20260810 06:44:19.500480 19527 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:19.500547 19527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:19.500674 19527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:19.501796 19527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "fc3b83e800514918bef8fe33af6a65eb"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "8b5a6978b5b05180383ce7cd91c2e9fe"
server_key_iv: "9c74efcb77f5a9a786e83db6074af657"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.502120 19527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "fc3b83e800514918bef8fe33af6a65eb"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "8b5a6978b5b05180383ce7cd91c2e9fe"
server_key_iv: "9c74efcb77f5a9a786e83db6074af657"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.503327 19527 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:44:19.504061 19543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.504257 19527 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:19.504343 19527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "fc3b83e800514918bef8fe33af6a65eb"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "8b5a6978b5b05180383ce7cd91c2e9fe"
server_key_iv: "9c74efcb77f5a9a786e83db6074af657"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.504397 19527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:19.526906 19527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:19.527172 19527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:19.527275 19527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:19.531723 19527 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:43549
I20260810 06:44:19.531785 19617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:43549 every 8 connection(s)
I20260810 06:44:19.532140 19527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:19.533141 19618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:19.535492 19618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb: Bootstrap starting.
I20260810 06:44:19.536105 19618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:19.536423 19618 log.cc:824] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:19.537133 19618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb: No bootstrap required, opened a new log
I20260810 06:44:19.538764 19618 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3b83e800514918bef8fe33af6a65eb" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 43549 } }
I20260810 06:44:19.538905 19618 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:19.538928 19618 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc3b83e800514918bef8fe33af6a65eb, State: Initialized, Role: FOLLOWER
I20260810 06:44:19.539068 19618 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3b83e800514918bef8fe33af6a65eb" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 43549 } }
I20260810 06:44:19.539151 19618 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:19.539175 19618 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:19.539203 19618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:19.539688 19618 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3b83e800514918bef8fe33af6a65eb" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 43549 } }
I20260810 06:44:19.539773 19618 leader_election.cc:302] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc3b83e800514918bef8fe33af6a65eb; no voters:
I20260810 06:44:19.539901 19618 leader_election.cc:288] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:19.539963 19626 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:19.540158 19626 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [term 1 LEADER]: Becoming Leader. State: Replica: fc3b83e800514918bef8fe33af6a65eb, State: Running, Role: LEADER
I20260810 06:44:19.540227 19618 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:19.540309 19626 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3b83e800514918bef8fe33af6a65eb" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 43549 } }
I20260810 06:44:19.540728 19629 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc3b83e800514918bef8fe33af6a65eb. Latest consensus state: current_term: 1 leader_uuid: "fc3b83e800514918bef8fe33af6a65eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3b83e800514918bef8fe33af6a65eb" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 43549 } } }
I20260810 06:44:19.540807 19628 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc3b83e800514918bef8fe33af6a65eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3b83e800514918bef8fe33af6a65eb" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 43549 } } }
I20260810 06:44:19.540865 19628 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:19.540824 19629 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:19.541209 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 19527
I20260810 06:44:19.541314 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:19.541546 27814 external_mini_cluster.cc:1428] Setting key a17043529f9a7baa1216cde7bbe8c3d4
I20260810 06:44:19.541792 19640 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:19.542407 19640 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:19.543959 19640 catalog_manager.cc:1347] Generated new cluster ID: ed030e117b9b49a493cb503bad3e7ea8
I20260810 06:44:19.544018 19640 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:19.547170 19663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.542206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40274 (local address 127.27.41.190:43549)
0810 06:44:19.542409 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:19.542418 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:19.542442 (+ 24us) server_negotiation.cc:407] Connection header received
0810 06:44:19.542575 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:19.542589 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:19.542650 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:19.542787 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:19.543015 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.544309 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.545115 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.545654 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.545795 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.546513 (+ 718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:19.546516 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:19.546517 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:19.546692 (+ 175us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:19.546725 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:19.546735 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:19.546813 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:19.546889 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 06:44:19.546966 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":91,"threads_started":1}
I20260810 06:44:19.565267 19640 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:19.565811 19640 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:19.574335 19640 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb: Generated new TSK 0
I20260810 06:44:19.574534 19640 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:19.579295 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:43549
--builtin_ntp_servers=127.27.41.148:37533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 06:44:19.674145 19665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:19.674376 19665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:19.674413 19665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:19.675607 19665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:19.675664 19665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:19.675702 19665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:44:19.677060 19665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:43549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:19.677315 19665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:19.677649 19665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:19.683995 19675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:19.683964 19676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:19.684152 19665 server_base.cc:1034] running on GCE node
W20260810 06:44:19.683975 19679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:19.684412 19665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:19.684671 19665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:19.685825 19665 hybrid_clock.cc:648] HybridClock initialized: now 1786344259685819 us; error 37 us; skew 500 ppm
I20260810 06:44:19.687332 19665 webserver.cc:460] Webserver started at http://127.27.41.129:40895/ using document root <none> and password file <none>
I20260810 06:44:19.687609 19665 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:19.687669 19665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:19.687794 19665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:19.689065 19665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "14ae6b23ac34426c8deea1d0cdc79c1c"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "8e9d8c57e64ebab991e3c79a4f36a52a"
server_key_iv: "c622e177a05314a675fa1658ea348c8c"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.689482 19665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "14ae6b23ac34426c8deea1d0cdc79c1c"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "8e9d8c57e64ebab991e3c79a4f36a52a"
server_key_iv: "c622e177a05314a675fa1658ea348c8c"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.691061 19665 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:44:19.691762 19691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.691931 19665 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:19.692018 19665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "14ae6b23ac34426c8deea1d0cdc79c1c"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "8e9d8c57e64ebab991e3c79a4f36a52a"
server_key_iv: "c622e177a05314a675fa1658ea348c8c"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.692072 19665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:19.712590 19665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:19.712857 19665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:19.712958 19665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:19.713145 19665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:19.713487 19665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:19.713524 19665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.713552 19665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:19.713567 19665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.719738 19665 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:41257
I20260810 06:44:19.719821 19860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:41257 every 8 connection(s)
I20260810 06:44:19.720152 19665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:44:19.725133 19663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.720915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:51129 (local address 127.27.41.190:43549)
0810 06:44:19.721002 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:19.721004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:19.721237 (+ 233us) server_negotiation.cc:407] Connection header received
0810 06:44:19.721790 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:19.721791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:19.721803 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:19.721854 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:19.722484 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.722973 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.723919 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.724110 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.724160 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.724891 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:19.724892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:19.724892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:19.724896 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:19.724910 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:19.724914 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:19.724957 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:19.725042 (+ 85us) server_negotiation.cc:299] Negotiation successful
0810 06:44:19.725075 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:44:19.725299 19864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.720884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:43549 (local address 127.27.41.129:51129)
0810 06:44:19.721107 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:19.721149 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:19.721696 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:19.721913 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:19.721916 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:19.721924 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:19.722412 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.722416 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.723069 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.723070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.723843 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.723845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.724187 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.724188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.724295 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.724761 (+ 466us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:44:19.724762 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:19.724788 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:44:19.724809 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:19.724970 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:19.724974 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:19.724976 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:44:19.725028 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 06:44:19.725109 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":119,"threads_started":1}
I20260810 06:44:19.725841 19862 heartbeater.cc:347] Connected to a master server at 127.27.41.190:43549
I20260810 06:44:19.725917 19862 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:19.726123 19862 heartbeater.cc:511] Master 127.27.41.190:43549 requested a full tablet report, sending...
I20260810 06:44:19.726145 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 19665
I20260810 06:44:19.726243 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:44:19.726469 27814 external_mini_cluster.cc:1428] Setting key a4b7a67dcc649093bbc9edb0651c8f00
I20260810 06:44:19.726795 19561 ts_manager.cc:194] Registered new tserver with Master: 14ae6b23ac34426c8deea1d0cdc79c1c (127.27.41.129:41257)
I20260810 06:44:19.727609 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:43549
--builtin_ntp_servers=127.27.41.148:37533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 06:44:19.727605 19561 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.41.129:51129
W20260810 06:44:19.810889 19865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:19.811100 19865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:19.811122 19865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:19.812292 19865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:19.812333 19865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:19.812359 19865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:44:19.813746 19865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:43549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:19.814011 19865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:19.814319 19865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:19.819839 19872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:19.820019 19865 server_base.cc:1034] running on GCE node
W20260810 06:44:19.819846 19873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:19.820276 19876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:19.820505 19865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:19.820762 19865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:19.821929 19865 hybrid_clock.cc:648] HybridClock initialized: now 1786344259821909 us; error 36 us; skew 500 ppm
I20260810 06:44:19.823130 19865 webserver.cc:460] Webserver started at http://127.27.41.130:36823/ using document root <none> and password file <none>
I20260810 06:44:19.823383 19865 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:19.823457 19865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:19.823612 19865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:19.824648 19865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "761fc8034d2c404e9bd308a61b828c7d"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "4d043cf5b0879ef036549fa1a0e81455"
server_key_iv: "cb4f70bb02141682a6d9339f4c872961"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.825021 19865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "761fc8034d2c404e9bd308a61b828c7d"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "4d043cf5b0879ef036549fa1a0e81455"
server_key_iv: "cb4f70bb02141682a6d9339f4c872961"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.826377 19865 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:44:19.827082 19885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.827252 19865 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:19.827356 19865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "761fc8034d2c404e9bd308a61b828c7d"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "4d043cf5b0879ef036549fa1a0e81455"
server_key_iv: "cb4f70bb02141682a6d9339f4c872961"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.827430 19865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:19.855160 19865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:19.855518 19865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:19.855681 19865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:19.855933 19865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:19.856252 19865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:19.856307 19865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.856348 19865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:19.856374 19865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.862061 19865 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:37629
I20260810 06:44:19.862123 20053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:37629 every 8 connection(s)
I20260810 06:44:19.862434 19865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:44:19.863408 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 19865
I20260810 06:44:19.863583 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:44:19.863793 27814 external_mini_cluster.cc:1428] Setting key 672e16df9aadb4da1c7eb58b8ac23e7f
I20260810 06:44:19.864789 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:43549
--builtin_ntp_servers=127.27.41.148:37533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 06:44:19.868132 19663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.863140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:57867 (local address 127.27.41.190:43549)
0810 06:44:19.863229 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:19.863263 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:19.863519 (+ 256us) server_negotiation.cc:407] Connection header received
0810 06:44:19.864169 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:19.864171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:19.864185 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:19.864236 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:19.865006 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.865719 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.866688 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.866885 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.866960 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.867826 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:19.867827 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:19.867828 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:19.867832 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:19.867854 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:19.867858 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:19.867919 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:19.868017 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 06:44:19.868049 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 06:44:19.868333 20056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.863116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:43549 (local address 127.27.41.130:57867)
0810 06:44:19.863370 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:19.863410 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:19.864025 (+ 615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:19.864315 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:19.864318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:19.864326 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:19.864925 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.864934 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.865819 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.865820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.866588 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.866590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.866983 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.866984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.867122 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.867686 (+ 564us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:44:19.867686 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:19.867713 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:44:19.867734 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:19.867921 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:19.867928 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:19.867931 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:44:19.868018 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 06:44:19.868117 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":133,"threads_started":1}
I20260810 06:44:19.868834 20054 heartbeater.cc:347] Connected to a master server at 127.27.41.190:43549
I20260810 06:44:19.868916 20054 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:19.869107 20054 heartbeater.cc:511] Master 127.27.41.190:43549 requested a full tablet report, sending...
I20260810 06:44:19.869534 19561 ts_manager.cc:194] Registered new tserver with Master: 761fc8034d2c404e9bd308a61b828c7d (127.27.41.130:37629)
I20260810 06:44:19.870076 19561 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.41.130:57867
W20260810 06:44:19.947590 20057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:19.947789 20057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:19.947809 20057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:19.948925 20057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:19.948966 20057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:19.948989 20057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:44:19.950402 20057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:43549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:19.950650 20057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:19.950958 20057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:19.955960 20066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:19.955999 20065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:19.955969 20070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:19.956398 20057 server_base.cc:1034] running on GCE node
I20260810 06:44:19.956648 20057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:19.956892 20057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:19.958055 20057 hybrid_clock.cc:648] HybridClock initialized: now 1786344259958043 us; error 25 us; skew 500 ppm
I20260810 06:44:19.959353 20057 webserver.cc:460] Webserver started at http://127.27.41.131:44267/ using document root <none> and password file <none>
I20260810 06:44:19.959609 20057 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:19.959681 20057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:19.959829 20057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:19.960866 20057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "cc0383192ffc4d76b7fd91a4257ac2cd"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "ad1588212d41d196f1cb1969d6893dec"
server_key_iv: "18e72cece1cafe1834748a9a71facef4"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.961272 20057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "cc0383192ffc4d76b7fd91a4257ac2cd"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "ad1588212d41d196f1cb1969d6893dec"
server_key_iv: "18e72cece1cafe1834748a9a71facef4"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.962613 20057 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:44:19.963315 20081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.963501 20057 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:19.963613 20057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "cc0383192ffc4d76b7fd91a4257ac2cd"
format_stamp: "Formatted at 2026-08-10 06:44:19 on dist-test-slave-bw88"
server_key: "ad1588212d41d196f1cb1969d6893dec"
server_key_iv: "18e72cece1cafe1834748a9a71facef4"
server_key_version: "encryptionkey@0"
I20260810 06:44:19.963685 20057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:19.974419 20057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:19.974717 20057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:19.974869 20057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:19.975096 20057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:19.975409 20057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:19.975464 20057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.975497 20057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:19.975523 20057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:19.981539 20057 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:43965
I20260810 06:44:19.981603 20250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:43965 every 8 connection(s)
I20260810 06:44:19.981946 20057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:44:19.987398 19663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.982717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:60257 (local address 127.27.41.190:43549)
0810 06:44:19.982799 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:19.982801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:19.983057 (+ 256us) server_negotiation.cc:407] Connection header received
0810 06:44:19.983600 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:19.983602 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:19.983616 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:19.983672 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:19.984353 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.984867 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.985988 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.986198 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.986279 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.987087 (+ 808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:19.987088 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:19.987088 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:19.987094 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:19.987110 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:19.987114 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:19.987185 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:19.987290 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 06:44:19.987322 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 06:44:19.987622 20254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:19.982676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:43549 (local address 127.27.41.131:60257)
0810 06:44:19.982914 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:19.982957 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:19.983477 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:19.983738 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:19.983742 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:19.983752 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:19.984255 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.984259 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.984972 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.984973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.985880 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:19.985883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:19.986291 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:19.986292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:19.986425 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:19.986912 (+ 487us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:44:19.986913 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:19.986939 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:44:19.986960 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:19.987185 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:19.987192 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:19.987195 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:44:19.987293 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 06:44:19.987392 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
I20260810 06:44:19.988054 20251 heartbeater.cc:347] Connected to a master server at 127.27.41.190:43549
I20260810 06:44:19.988159 20251 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:19.990906 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 20057
I20260810 06:44:19.991024 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:44:19.991223 27814 external_mini_cluster.cc:1428] Setting key 873fa20b076bfbbcdbe13343fca317c6
I20260810 06:44:19.994007 20251 heartbeater.cc:511] Master 127.27.41.190:43549 requested a full tablet report, sending...
I20260810 06:44:19.994447 19561 ts_manager.cc:194] Registered new tserver with Master: cc0383192ffc4d76b7fd91a4257ac2cd (127.27.41.131:43965)
I20260810 06:44:19.994902 19561 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.41.131:60257
I20260810 06:44:20.003219 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:44:20.008761 19663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:20.004911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40290 (local address 127.27.41.190:43549)
0810 06:44:20.004985 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:20.004987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:20.005116 (+ 129us) server_negotiation.cc:407] Connection header received
0810 06:44:20.005195 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:20.005196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:20.005209 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:20.005258 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:20.005594 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.006467 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.007259 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.007610 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.007691 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:20.008449 (+ 758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:20.008450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:20.008451 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:20.008457 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:20.008474 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:20.008479 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:20.008536 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:20.008603 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 06:44:20.008636 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 06:44:20.010514 19561 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40290:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:44:20.012149 19561 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:44:20.019867 20262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:20.014516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:43965 (local address 127.0.0.1:56008)
0810 06:44:20.014702 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:20.014740 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:20.014804 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:20.015375 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:20.015378 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:20.015380 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:20.015445 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:20.015446 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.016804 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.016806 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:20.018358 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:20.018362 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.019479 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.019480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:20.019598 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:20.019618 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 06:44:20.019673 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 06:44:20.019746 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":79,"threads_started":1}
I20260810 06:44:20.020020 20267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:20.014516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:37629 (local address 127.0.0.1:56118)
0810 06:44:20.014987 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:20.014998 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:20.015044 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:20.015433 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:20.015434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:20.015435 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:20.015491 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:20.015492 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.017389 (+ 1897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.017390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:20.018472 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:20.018475 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.019763 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.019764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:20.019838 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:20.019842 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:44:20.019890 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 06:44:20.019928 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":1,"thread_start_us":77,"threads_started":1}
I20260810 06:44:20.020293 20270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:20.014908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56118 (local address 127.27.41.130:37629)
0810 06:44:20.015223 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:20.015227 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:20.015236 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:44:20.015273 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:20.015275 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:20.015291 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:20.015362 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:20.015586 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.016712 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.018569 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.019269 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.019612 (+ 343us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:20.019721 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:20.020158 (+ 437us) server_negotiation.cc:299] Negotiation successful
0810 06:44:20.020215 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":87,"threads_started":1}
I20260810 06:44:20.020411 20265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:20.014723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56008 (local address 127.27.41.131:43965)
0810 06:44:20.015178 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:20.015183 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:20.015195 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:44:20.015240 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:20.015242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:20.015259 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:20.015574 (+ 315us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:20.015640 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.016727 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.018475 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.019360 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.020091 (+ 731us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:20.020217 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:20.020245 (+ 28us) server_negotiation.cc:299] Negotiation successful
0810 06:44:20.020299 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":93,"threads_started":1}
I20260810 06:44:20.020993 19951 tablet_service.cc:1467] Processing CreateTablet for tablet 3a977db4efb64231baaa5c7cfb777ad8 (DEFAULT_TABLE table=test-table [id=d7fc748deddd42d29be438349a522ed5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:20.021093 20156 tablet_service.cc:1467] Processing CreateTablet for tablet 3a977db4efb64231baaa5c7cfb777ad8 (DEFAULT_TABLE table=test-table [id=d7fc748deddd42d29be438349a522ed5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:20.021456 19951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a977db4efb64231baaa5c7cfb777ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:20.021550 20156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a977db4efb64231baaa5c7cfb777ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:20.021602 20263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:20.014738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:41257 (local address 127.0.0.1:56414)
0810 06:44:20.016842 (+ 2104us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:20.016852 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:20.016930 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:20.017187 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:20.017188 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:20.017190 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:20.017233 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:20.017235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.018521 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.018522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:20.019517 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:20.019520 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.021118 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.021119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:20.021277 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:20.021282 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:44:20.021435 (+ 153us) client_negotiation.cc:240] Negotiation successful
0810 06:44:20.021480 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2092,"thread_start_us":91,"threads_started":1}
I20260810 06:44:20.022169 20271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:20.014985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56414 (local address 127.27.41.129:41257)
0810 06:44:20.015551 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:20.015556 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:20.016928 (+ 1372us) server_negotiation.cc:407] Connection header received
0810 06:44:20.016996 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:20.016999 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:20.017013 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:20.017113 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:20.017315 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.018426 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.019604 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.020921 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.020989 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:20.021081 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:20.022043 (+ 962us) server_negotiation.cc:299] Negotiation successful
0810 06:44:20.022091 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":106,"threads_started":1}
I20260810 06:44:20.022907 19764 tablet_service.cc:1467] Processing CreateTablet for tablet 3a977db4efb64231baaa5c7cfb777ad8 (DEFAULT_TABLE table=test-table [id=d7fc748deddd42d29be438349a522ed5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:20.023270 19764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a977db4efb64231baaa5c7cfb777ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:20.025810 20273 tablet_bootstrap.cc:492] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d: Bootstrap starting.
I20260810 06:44:20.026551 20273 tablet_bootstrap.cc:654] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:20.026839 20275 tablet_bootstrap.cc:492] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c: Bootstrap starting.
I20260810 06:44:20.026894 20273 log.cc:824] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:20.027554 20275 tablet_bootstrap.cc:654] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:20.027676 20273 tablet_bootstrap.cc:492] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d: No bootstrap required, opened a new log
I20260810 06:44:20.027760 20273 ts_tablet_manager.cc:1397] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:44:20.027943 20275 log.cc:824] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:20.029538 20274 tablet_bootstrap.cc:492] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd: Bootstrap starting.
I20260810 06:44:20.030115 20273 raft_consensus.cc:348] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc0383192ffc4d76b7fd91a4257ac2cd" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 43965 } } peers { permanent_uuid: "761fc8034d2c404e9bd308a61b828c7d" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37629 } } peers { permanent_uuid: "14ae6b23ac34426c8deea1d0cdc79c1c" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41257 } }
I20260810 06:44:20.030320 20274 tablet_bootstrap.cc:654] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:20.030354 20273 raft_consensus.cc:374] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:20.030402 20273 raft_consensus.cc:729] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 761fc8034d2c404e9bd308a61b828c7d, State: Initialized, Role: FOLLOWER
I20260810 06:44:20.030519 20273 consensus_queue.cc:260] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc0383192ffc4d76b7fd91a4257ac2cd" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 43965 } } peers { permanent_uuid: "761fc8034d2c404e9bd308a61b828c7d" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37629 } } peers { permanent_uuid: "14ae6b23ac34426c8deea1d0cdc79c1c" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41257 } }
I20260810 06:44:20.030670 20274 log.cc:824] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:20.030844 20273 ts_tablet_manager.cc:1428] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:44:20.031008 20054 heartbeater.cc:503] Master 127.27.41.190:43549 was elected leader, sending a full tablet report...
I20260810 06:44:20.031673 20275 tablet_bootstrap.cc:492] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c: No bootstrap required, opened a new log
I20260810 06:44:20.031801 20275 ts_tablet_manager.cc:1397] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 06:44:20.032361 20274 tablet_bootstrap.cc:492] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd: No bootstrap required, opened a new log
I20260810 06:44:20.032438 20274 ts_tablet_manager.cc:1397] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:44:20.034315 20275 raft_consensus.cc:348] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc0383192ffc4d76b7fd91a4257ac2cd" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 43965 } } peers { permanent_uuid: "761fc8034d2c404e9bd308a61b828c7d" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37629 } } peers { permanent_uuid: "14ae6b23ac34426c8deea1d0cdc79c1c" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41257 } }
I20260810 06:44:20.034539 20275 raft_consensus.cc:374] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:20.034631 20275 raft_consensus.cc:729] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ae6b23ac34426c8deea1d0cdc79c1c, State: Initialized, Role: FOLLOWER
I20260810 06:44:20.034807 20275 consensus_queue.cc:260] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc0383192ffc4d76b7fd91a4257ac2cd" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 43965 } } peers { permanent_uuid: "761fc8034d2c404e9bd308a61b828c7d" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37629 } } peers { permanent_uuid: "14ae6b23ac34426c8deea1d0cdc79c1c" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41257 } }
I20260810 06:44:20.035151 20275 ts_tablet_manager.cc:1428] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:44:20.035228 19862 heartbeater.cc:503] Master 127.27.41.190:43549 was elected leader, sending a full tablet report...
I20260810 06:44:20.035162 20274 raft_consensus.cc:348] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc0383192ffc4d76b7fd91a4257ac2cd" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 43965 } } peers { permanent_uuid: "761fc8034d2c404e9bd308a61b828c7d" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37629 } } peers { permanent_uuid: "14ae6b23ac34426c8deea1d0cdc79c1c" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41257 } }
I20260810 06:44:20.035588 20274 raft_consensus.cc:374] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:20.035638 20274 raft_consensus.cc:729] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc0383192ffc4d76b7fd91a4257ac2cd, State: Initialized, Role: FOLLOWER
I20260810 06:44:20.035778 20274 consensus_queue.cc:260] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc0383192ffc4d76b7fd91a4257ac2cd" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 43965 } } peers { permanent_uuid: "761fc8034d2c404e9bd308a61b828c7d" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37629 } } peers { permanent_uuid: "14ae6b23ac34426c8deea1d0cdc79c1c" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41257 } }
I20260810 06:44:20.036055 20274 ts_tablet_manager.cc:1428] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 06:44:20.036180 20251 heartbeater.cc:503] Master 127.27.41.190:43549 was elected leader, sending a full tablet report...
W20260810 06:44:20.113004 20055 tablet.cc:2369] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:44:20.220999 19863 tablet.cc:2369] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:44:20.232518 20253 tablet.cc:2369] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:44:20.383921 20278 raft_consensus.cc:482] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:44:20.384059 20278 raft_consensus.cc:504] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc0383192ffc4d76b7fd91a4257ac2cd" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 43965 } } peers { permanent_uuid: "761fc8034d2c404e9bd308a61b828c7d" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37629 } } peers { permanent_uuid: "14ae6b23ac34426c8deea1d0cdc79c1c" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41257 } }
I20260810 06:44:20.384377 20278 leader_election.cc:288] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc0383192ffc4d76b7fd91a4257ac2cd (127.27.41.131:43965), 14ae6b23ac34426c8deea1d0cdc79c1c (127.27.41.129:41257)
I20260810 06:44:20.387357 20284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:20.384582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:41257 (local address 127.27.41.130:38301)
0810 06:44:20.384730 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:20.384742 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:20.384807 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:20.384960 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:20.384961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:20.384963 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:20.385050 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:20.385052 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.385733 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.385734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:20.386532 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:20.386534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.387080 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.387081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:20.387158 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:20.387161 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:44:20.387224 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 06:44:20.387266 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":72,"threads_started":1}
I20260810 06:44:20.387343 20271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:20.384675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:38301 (local address 127.27.41.129:41257)
0810 06:44:20.384736 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:20.384739 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:20.384793 (+ 54us) server_negotiation.cc:407] Connection header received
0810 06:44:20.384883 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:20.384884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:20.384892 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:20.384953 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:20.385121 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.385650 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.386627 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.386985 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.387073 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:20.387082 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:20.387242 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 06:44:20.387279 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 06:44:20.387437 20265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:20.384697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:52263 (local address 127.27.41.131:43965)
0810 06:44:20.384740 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:20.384743 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:20.384855 (+ 112us) server_negotiation.cc:407] Connection header received
0810 06:44:20.384944 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:20.384945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:20.384956 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:20.385029 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:20.385199 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.385736 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.386703 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.387079 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.387167 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:20.387175 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:20.387332 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 06:44:20.387372 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 06:44:20.387459 20283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:20.384583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:43965 (local address 127.27.41.130:52263)
0810 06:44:20.384767 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:20.384777 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:20.384873 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:20.385034 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:20.385035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:20.385036 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:20.385121 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:20.385123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.385820 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.385821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:20.386605 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:20.386606 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.387169 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.387170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:20.387255 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:20.387259 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:44:20.387326 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 06:44:20.387365 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":15,"thread_start_us":58,"threads_started":1}
I20260810 06:44:20.387694 19791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a977db4efb64231baaa5c7cfb777ad8" candidate_uuid: "761fc8034d2c404e9bd308a61b828c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14ae6b23ac34426c8deea1d0cdc79c1c" is_pre_election: true
I20260810 06:44:20.387872 19791 raft_consensus.cc:2454] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761fc8034d2c404e9bd308a61b828c7d in term 0.
I20260810 06:44:20.387816 20181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a977db4efb64231baaa5c7cfb777ad8" candidate_uuid: "761fc8034d2c404e9bd308a61b828c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc0383192ffc4d76b7fd91a4257ac2cd" is_pre_election: true
I20260810 06:44:20.388011 20181 raft_consensus.cc:2454] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 761fc8034d2c404e9bd308a61b828c7d in term 0.
I20260810 06:44:20.388135 19889 leader_election.cc:302] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14ae6b23ac34426c8deea1d0cdc79c1c, 761fc8034d2c404e9bd308a61b828c7d; no voters:
I20260810 06:44:20.388302 20278 raft_consensus.cc:2781] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:44:20.388367 20278 raft_consensus.cc:482] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:44:20.388402 20278 raft_consensus.cc:3037] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:20.389194 20278 raft_consensus.cc:504] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc0383192ffc4d76b7fd91a4257ac2cd" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 43965 } } peers { permanent_uuid: "761fc8034d2c404e9bd308a61b828c7d" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37629 } } peers { permanent_uuid: "14ae6b23ac34426c8deea1d0cdc79c1c" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41257 } }
I20260810 06:44:20.389374 20278 leader_election.cc:288] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [CANDIDATE]: Term 1 election: Requested vote from peers cc0383192ffc4d76b7fd91a4257ac2cd (127.27.41.131:43965), 14ae6b23ac34426c8deea1d0cdc79c1c (127.27.41.129:41257)
I20260810 06:44:20.389503 20181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a977db4efb64231baaa5c7cfb777ad8" candidate_uuid: "761fc8034d2c404e9bd308a61b828c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc0383192ffc4d76b7fd91a4257ac2cd"
I20260810 06:44:20.389528 19791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a977db4efb64231baaa5c7cfb777ad8" candidate_uuid: "761fc8034d2c404e9bd308a61b828c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14ae6b23ac34426c8deea1d0cdc79c1c"
I20260810 06:44:20.389582 20181 raft_consensus.cc:3037] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:20.389636 19791 raft_consensus.cc:3037] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:20.390419 20181 raft_consensus.cc:2454] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761fc8034d2c404e9bd308a61b828c7d in term 1.
I20260810 06:44:20.390422 19791 raft_consensus.cc:2454] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 761fc8034d2c404e9bd308a61b828c7d in term 1.
I20260810 06:44:20.390604 19887 leader_election.cc:302] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 761fc8034d2c404e9bd308a61b828c7d, cc0383192ffc4d76b7fd91a4257ac2cd; no voters:
I20260810 06:44:20.390717 20278 raft_consensus.cc:2781] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:20.390875 20278 raft_consensus.cc:686] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [term 1 LEADER]: Becoming Leader. State: Replica: 761fc8034d2c404e9bd308a61b828c7d, State: Running, Role: LEADER
I20260810 06:44:20.390982 20278 consensus_queue.cc:237] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc0383192ffc4d76b7fd91a4257ac2cd" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 43965 } } peers { permanent_uuid: "761fc8034d2c404e9bd308a61b828c7d" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37629 } } peers { permanent_uuid: "14ae6b23ac34426c8deea1d0cdc79c1c" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41257 } }
I20260810 06:44:20.391844 19561 catalog_manager.cc:5495] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d reported cstate change: term changed from 0 to 1, leader changed from <none> to 761fc8034d2c404e9bd308a61b828c7d (127.27.41.130). New cstate: current_term: 1 leader_uuid: "761fc8034d2c404e9bd308a61b828c7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc0383192ffc4d76b7fd91a4257ac2cd" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "761fc8034d2c404e9bd308a61b828c7d" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14ae6b23ac34426c8deea1d0cdc79c1c" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41257 } health_report { overall_health: UNKNOWN } } }
I20260810 06:44:20.461247 20270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:20.458752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56128 (local address 127.27.41.130:37629)
0810 06:44:20.458828 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:20.458830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:20.458842 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:44:20.458900 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:20.458901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:20.458927 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:20.459012 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:20.459161 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.459651 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.460410 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:20.460632 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:20.460710 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:20.460886 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:20.460998 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:20.461103 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:20.461128 (+ 25us) server_negotiation.cc:299] Negotiation successful
0810 06:44:20.461158 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 06:44:20.463270 20181 raft_consensus.cc:1261] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd [term 1 FOLLOWER]: Refusing update from remote peer 761fc8034d2c404e9bd308a61b828c7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:20.463284 19791 raft_consensus.cc:1261] T 3a977db4efb64231baaa5c7cfb777ad8 P 14ae6b23ac34426c8deea1d0cdc79c1c [term 1 FOLLOWER]: Refusing update from remote peer 761fc8034d2c404e9bd308a61b828c7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:20.463737 20285 consensus_queue.cc:1035] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc0383192ffc4d76b7fd91a4257ac2cd" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:20.463899 20278 consensus_queue.cc:1035] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "14ae6b23ac34426c8deea1d0cdc79c1c" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:20.466445 20290 mvcc.cc:205] Tried to move back new op lower bound from 7316866090854338560 to 7316866090562031616. Current Snapshot: MvccSnapshot[applied={T|T < 7316866090854338560}]
I20260810 06:44:20.466907 20288 mvcc.cc:205] Tried to move back new op lower bound from 7316866090854338560 to 7316866090562031616. Current Snapshot: MvccSnapshot[applied={T|T < 7316866090854338560}]
I20260810 06:44:20.467201 20291 mvcc.cc:205] Tried to move back new op lower bound from 7316866090854338560 to 7316866090562031616. Current Snapshot: MvccSnapshot[applied={T|T < 7316866090854338560 or (T in {7316866090854338560})}]
I20260810 06:44:20.469198 19568 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:44:20.469297 19568 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:44:20.470104 19568 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc3b83e800514918bef8fe33af6a65eb: Sending DeleteTablet for 3 replicas of tablet 3a977db4efb64231baaa5c7cfb777ad8
I20260810 06:44:20.470438 20156 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a977db4efb64231baaa5c7cfb777ad8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:20 UTC) from {username='slave'} at 127.0.0.1:56008
I20260810 06:44:20.470448 19951 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a977db4efb64231baaa5c7cfb777ad8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:20 UTC) from {username='slave'} at 127.0.0.1:56118
I20260810 06:44:20.470688 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 19665
I20260810 06:44:20.470752 19764 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a977db4efb64231baaa5c7cfb777ad8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:20 UTC) from {username='slave'} at 127.0.0.1:56414
I20260810 06:44:20.478613 20305 tablet_replica.cc:330] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd: stopping tablet replica
I20260810 06:44:20.478760 20305 raft_consensus.cc:2229] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:44:20.478904 20305 raft_consensus.cc:2258] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:44:20.479394 20305 ts_tablet_manager.cc:1905] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:44:20.481302 20305 ts_tablet_manager.cc:1918] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:44:20.481467 20305 log.cc:1196] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/3a977db4efb64231baaa5c7cfb777ad8
I20260810 06:44:20.481457 20306 tablet_replica.cc:330] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d: stopping tablet replica
I20260810 06:44:20.481592 20306 raft_consensus.cc:2229] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:44:20.481734 20306 raft_consensus.cc:2258] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:44:20.482131 20305 ts_tablet_manager.cc:1939] T 3a977db4efb64231baaa5c7cfb777ad8 P cc0383192ffc4d76b7fd91a4257ac2cd: Deleting consensus metadata
I20260810 06:44:20.482162 20306 ts_tablet_manager.cc:1905] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:44:20.482641 19545 catalog_manager.cc:4841] TS cc0383192ffc4d76b7fd91a4257ac2cd (127.27.41.131:43965): tablet 3a977db4efb64231baaa5c7cfb777ad8 (table test-table [id=d7fc748deddd42d29be438349a522ed5]) successfully deleted
I20260810 06:44:20.484222 20306 ts_tablet_manager.cc:1918] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:44:20.484318 20306 log.cc:1196] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/3a977db4efb64231baaa5c7cfb777ad8
I20260810 06:44:20.484592 20306 ts_tablet_manager.cc:1939] T 3a977db4efb64231baaa5c7cfb777ad8 P 761fc8034d2c404e9bd308a61b828c7d: Deleting consensus metadata
I20260810 06:44:20.485008 19547 catalog_manager.cc:4841] TS 761fc8034d2c404e9bd308a61b828c7d (127.27.41.130:37629): tablet 3a977db4efb64231baaa5c7cfb777ad8 (table test-table [id=d7fc748deddd42d29be438349a522ed5]) successfully deleted
W20260810 06:44:20.486579 19547 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:41257 (error 108)
I20260810 06:44:20.486882 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 19865
I20260810 06:44:20.487099 20267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:20.486921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:41257 (local address 127.0.0.1:56420)
0810 06:44:20.487008 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:20.487059 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:41257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260810 06:44:20.490875 19547 catalog_manager.cc:4584] TS 14ae6b23ac34426c8deea1d0cdc79c1c (127.27.41.129:41257): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3a977db4efb64231baaa5c7cfb777ad8: Network error: Client connection negotiation failed: client connection to 127.27.41.129:41257: connect: Connection refused (error 111)
I20260810 06:44:20.495520 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 20057
I20260810 06:44:20.502751 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 19527
2026-08-10T06:44:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1127 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:20 dist-test-slave-bw88 krb5kdc[20310](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:20 dist-test-slave-bw88 krb5kdc[20310](info): set up 2 sockets
Aug 10 06:44:20 dist-test-slave-bw88 krb5kdc[20310](info): commencing operation
krb5kdc: starting...
W20260810 06:44:21.718796 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:21 dist-test-slave-bw88 krb5kdc[20310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:44:21.834204 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:39763
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:39763
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:21.916162 20333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:21.916352 20333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:21.916373 20333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:21.917572 20333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:21.917616 20333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:21.917631 20333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:21.917644 20333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:21.917656 20333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:21.919214 20333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:39763
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:39763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:21.919476 20333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:21.919710 20333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:44:21.924765 20333 server_base.cc:1034] running on GCE node
W20260810 06:44:21.924695 20345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:21.924681 20347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:21.924680 20344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:21.925261 20333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:21.925611 20333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:21.926754 20333 hybrid_clock.cc:648] HybridClock initialized: now 1786344261926743 us; error 30 us; skew 500 ppm
Aug 10 06:44:21 dist-test-slave-bw88 krb5kdc[20310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344261, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:21.929241 20333 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:44:21.929700 20333 webserver.cc:460] Webserver started at http://127.27.41.190:40459/ using document root <none> and password file <none>
I20260810 06:44:21.929955 20333 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:21.930025 20333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:21.930177 20333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:21.931217 20333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "55d3e3d94b124303a7bce5b89b230a81"
format_stamp: "Formatted at 2026-08-10 06:44:21 on dist-test-slave-bw88"
server_key: "f78538d5c32fec6ca3dc53d80d34f593"
server_key_iv: "329d624b66d8a75783a4c445511b0eda"
server_key_version: "encryptionkey@0"
I20260810 06:44:21.931586 20333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "55d3e3d94b124303a7bce5b89b230a81"
format_stamp: "Formatted at 2026-08-10 06:44:21 on dist-test-slave-bw88"
server_key: "f78538d5c32fec6ca3dc53d80d34f593"
server_key_iv: "329d624b66d8a75783a4c445511b0eda"
server_key_version: "encryptionkey@0"
I20260810 06:44:21.932901 20333 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:44:21.933701 20354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:21.933871 20333 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:44:21.933981 20333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "55d3e3d94b124303a7bce5b89b230a81"
format_stamp: "Formatted at 2026-08-10 06:44:21 on dist-test-slave-bw88"
server_key: "f78538d5c32fec6ca3dc53d80d34f593"
server_key_iv: "329d624b66d8a75783a4c445511b0eda"
server_key_version: "encryptionkey@0"
I20260810 06:44:21.934062 20333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:21.948133 20333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:21.950028 20333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:21.950192 20333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:21.954147 20333 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:39763
I20260810 06:44:21.954192 20426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:39763 every 8 connection(s)
I20260810 06:44:21.954525 20333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:21.955431 20427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:21.957692 20427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81: Bootstrap starting.
I20260810 06:44:21.958348 20427 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:21.958644 20427 log.cc:824] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:21.958858 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 20333
I20260810 06:44:21.959007 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:21.959204 27814 external_mini_cluster.cc:1428] Setting key ddaf12ffe905c64689f679f2271edfb9
I20260810 06:44:21.959564 20427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81: No bootstrap required, opened a new log
I20260810 06:44:21.961927 20427 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55d3e3d94b124303a7bce5b89b230a81" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39763 } }
I20260810 06:44:21.962088 20427 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:21.962139 20427 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55d3e3d94b124303a7bce5b89b230a81, State: Initialized, Role: FOLLOWER
I20260810 06:44:21.962306 20427 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55d3e3d94b124303a7bce5b89b230a81" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39763 } }
I20260810 06:44:21.962401 20427 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:21.962445 20427 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:21.962493 20427 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:21.963016 20427 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55d3e3d94b124303a7bce5b89b230a81" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39763 } }
I20260810 06:44:21.963142 20427 leader_election.cc:302] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55d3e3d94b124303a7bce5b89b230a81; no voters:
I20260810 06:44:21.963339 20427 leader_election.cc:288] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:21.963362 20433 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:21.963581 20433 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [term 1 LEADER]: Becoming Leader. State: Replica: 55d3e3d94b124303a7bce5b89b230a81, State: Running, Role: LEADER
I20260810 06:44:21.963629 20427 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:21.964993 20433 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55d3e3d94b124303a7bce5b89b230a81" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39763 } }
I20260810 06:44:21.965677 20434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55d3e3d94b124303a7bce5b89b230a81. Latest consensus state: current_term: 1 leader_uuid: "55d3e3d94b124303a7bce5b89b230a81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55d3e3d94b124303a7bce5b89b230a81" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39763 } } }
I20260810 06:44:21.965888 20434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:21.965772 20436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55d3e3d94b124303a7bce5b89b230a81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55d3e3d94b124303a7bce5b89b230a81" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39763 } } }
I20260810 06:44:21.966086 20436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81 [sys.catalog]: This master's current role is: LEADER
W20260810 06:44:21.966297 20452 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:44:21.966358 20452 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:44:21.966451 20454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:21.966656 20454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 06:44:21 dist-test-slave-bw88 krb5kdc[20310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:21.968273 20454 catalog_manager.cc:1347] Generated new cluster ID: abf2db473c2b4124b8e060459fb0edce
I20260810 06:44:21.968328 20454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:21.971622 20432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:21.959797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46074 (local address 127.27.41.190:39763)
0810 06:44:21.959956 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:21.959965 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:21.960000 (+ 35us) server_negotiation.cc:407] Connection header received
0810 06:44:21.960819 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:21.960826 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:21.960872 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:21.960983 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:21.961853 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:21.963144 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:21.964204 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:21.964763 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:21.964892 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:21.967789 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:21.967793 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:21.967793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:21.967805 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:21.969951 (+ 2146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:21.970379 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:21.970383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:21.970383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:21.970487 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:21.970711 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:21.970712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:21.970712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:21.971020 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:21.971187 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:21.971261 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 06:44:21.971399 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260810 06:44:21.974432 20454 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:21.974900 20454 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:21.977833 20454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81: Generated new TSK 0
I20260810 06:44:21.978004 20454 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:44:22.004278 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:39763
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:22.086902 20460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:22.087128 20460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:22.087167 20460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:22.088268 20460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:22.088335 20460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:22.088378 20460 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:44:22.089859 20460 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:39763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20460
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:22.090129 20460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:22.090371 20460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:22.096371 20466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:22.096410 20468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:22.096484 20465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:22.096498 20460 server_base.cc:1034] running on GCE node
I20260810 06:44:22.096801 20460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:22.097052 20460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:22.098197 20460 hybrid_clock.cc:648] HybridClock initialized: now 1786344262098184 us; error 29 us; skew 500 ppm
Aug 10 06:44:22 dist-test-slave-bw88 krb5kdc[20310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344262, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:22.100840 20460 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:44:22.101320 20460 webserver.cc:460] Webserver started at http://127.27.41.129:33899/ using document root <none> and password file <none>
I20260810 06:44:22.101634 20460 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:22.101682 20460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:22.101852 20460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:22.102890 20460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "f5f4afac2efc4ad797c9d0db3a3caa32"
format_stamp: "Formatted at 2026-08-10 06:44:22 on dist-test-slave-bw88"
server_key: "22f1c3097afb87837d6efe4fb1a40d82"
server_key_iv: "2c991a3503b198fa1854cbff04205134"
server_key_version: "encryptionkey@0"
I20260810 06:44:22.103364 20460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "f5f4afac2efc4ad797c9d0db3a3caa32"
format_stamp: "Formatted at 2026-08-10 06:44:22 on dist-test-slave-bw88"
server_key: "22f1c3097afb87837d6efe4fb1a40d82"
server_key_iv: "2c991a3503b198fa1854cbff04205134"
server_key_version: "encryptionkey@0"
I20260810 06:44:22.104725 20460 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:44:22.105468 20480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:22.105661 20460 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:22.105757 20460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "f5f4afac2efc4ad797c9d0db3a3caa32"
format_stamp: "Formatted at 2026-08-10 06:44:22 on dist-test-slave-bw88"
server_key: "22f1c3097afb87837d6efe4fb1a40d82"
server_key_iv: "2c991a3503b198fa1854cbff04205134"
server_key_version: "encryptionkey@0"
I20260810 06:44:22.105831 20460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:22.118878 20460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:22.121220 20460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:22.121451 20460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:22.121699 20460 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:22.122020 20460 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:22.122056 20460 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:22.122099 20460 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:22.122125 20460 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:22.128422 20460 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:40483
I20260810 06:44:22.128490 20640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:40483 every 8 connection(s)
I20260810 06:44:22.128806 20460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:44:22.129554 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 20460
I20260810 06:44:22.129690 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:44:22.129904 27814 external_mini_cluster.cc:1428] Setting key 08dbe92350d1ada95744d4659b8e27a8
Aug 10 06:44:22 dist-test-slave-bw88 krb5kdc[20310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344262, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
I20260810 06:44:22.139603 20432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.129585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:41891 (local address 127.27.41.190:39763)
0810 06:44:22.129638 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:22.129640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:22.129880 (+ 240us) server_negotiation.cc:407] Connection header received
0810 06:44:22.130602 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:22.130603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:22.130615 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:22.130670 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:22.131648 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.132162 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.133736 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.133953 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.134019 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.136502 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:22.136503 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:22.136504 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:22.136513 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:22.138151 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:22.138584 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:22.138585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:22.138585 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:22.138647 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:22.138913 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:22.138914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:22.138915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:22.139039 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:22.139118 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:22.139399 (+ 281us) server_negotiation.cc:299] Negotiation successful
0810 06:44:22.139500 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 06:44:22.139779 20645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.129584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:39763 (local address 127.27.41.129:41891)
0810 06:44:22.129740 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:22.129782 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:22.130476 (+ 694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:22.130743 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:22.130747 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:22.131329 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:22.131534 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.131539 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.132270 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.132271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.133651 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.133655 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.134051 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.134052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.134214 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.134736 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:22.134746 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:22.136398 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:22.138245 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:22.138253 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:22.138255 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:22.138492 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:22.138717 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:22.138718 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:22.138719 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:22.138836 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:22.139108 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:22.139117 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:22.139264 (+ 147us) client_negotiation.cc:769] Sending connection context
0810 06:44:22.139377 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 06:44:22.139545 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":85,"threads_started":1}
I20260810 06:44:22.140271 20641 heartbeater.cc:347] Connected to a master server at 127.27.41.190:39763
I20260810 06:44:22.140362 20641 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:22.140569 20641 heartbeater.cc:511] Master 127.27.41.190:39763 requested a full tablet report, sending...
I20260810 06:44:22.141161 20376 ts_manager.cc:194] Registered new tserver with Master: f5f4afac2efc4ad797c9d0db3a3caa32 (127.27.41.129:40483)
I20260810 06:44:22.141820 20376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:41891
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:44:22.157652 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:39763
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:22.240850 20649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:22.241043 20649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:22.241065 20649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:22.242209 20649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:22.242245 20649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:22.242270 20649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:44:22.243726 20649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:39763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:22.243911 20649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:22.244071 20649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:22.249259 20656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:22.249301 20658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:22.249262 20654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:22.249303 20649 server_base.cc:1034] running on GCE node
I20260810 06:44:22.249761 20649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:22.250017 20649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:22.251186 20649 hybrid_clock.cc:648] HybridClock initialized: now 1786344262251167 us; error 31 us; skew 500 ppm
Aug 10 06:44:22 dist-test-slave-bw88 krb5kdc[20310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344262, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:22.253700 20649 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:44:22.254285 20649 webserver.cc:460] Webserver started at http://127.27.41.130:36779/ using document root <none> and password file <none>
I20260810 06:44:22.254529 20649 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:22.254603 20649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:22.254755 20649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:22.255822 20649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "6b956190b82b4a3d82f47813af476582"
format_stamp: "Formatted at 2026-08-10 06:44:22 on dist-test-slave-bw88"
server_key: "7c388101084cda18e1956fe690b744ff"
server_key_iv: "46daf3b56c0955960ce48640f7b6ac27"
server_key_version: "encryptionkey@0"
I20260810 06:44:22.256201 20649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "6b956190b82b4a3d82f47813af476582"
format_stamp: "Formatted at 2026-08-10 06:44:22 on dist-test-slave-bw88"
server_key: "7c388101084cda18e1956fe690b744ff"
server_key_iv: "46daf3b56c0955960ce48640f7b6ac27"
server_key_version: "encryptionkey@0"
I20260810 06:44:22.257596 20649 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:44:22.258296 20668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:22.258459 20649 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:22.258565 20649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "6b956190b82b4a3d82f47813af476582"
format_stamp: "Formatted at 2026-08-10 06:44:22 on dist-test-slave-bw88"
server_key: "7c388101084cda18e1956fe690b744ff"
server_key_iv: "46daf3b56c0955960ce48640f7b6ac27"
server_key_version: "encryptionkey@0"
I20260810 06:44:22.258653 20649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:22.274060 20649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:22.275894 20649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:22.276057 20649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:22.276293 20649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:22.276602 20649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:22.276670 20649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:22.276710 20649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:22.276736 20649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:22.282970 20649 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:36551
I20260810 06:44:22.283005 20839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:36551 every 8 connection(s)
I20260810 06:44:22.283346 20649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
Aug 10 06:44:22 dist-test-slave-bw88 krb5kdc[20310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344262, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:22.292727 20432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.284129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:48321 (local address 127.27.41.190:39763)
0810 06:44:22.284189 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:22.284191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:22.284367 (+ 176us) server_negotiation.cc:407] Connection header received
0810 06:44:22.284848 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:22.284849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:22.284858 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:22.284914 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:22.285895 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.286394 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.287377 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.287659 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.287727 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.290132 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:22.290134 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:22.290134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:22.290141 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:22.291309 (+ 1168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:22.291732 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:22.291734 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:22.291734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:22.291797 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:22.292069 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:22.292070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:22.292071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:22.292191 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:22.292266 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:22.292548 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 06:44:22.292636 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 06:44:22.292908 20846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.284085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:39763 (local address 127.27.41.130:48321)
0810 06:44:22.284243 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:22.284284 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:22.284764 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:22.284965 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:22.284968 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:22.285618 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:22.285814 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.285819 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.286477 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.286477 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.287260 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.287262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.287754 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.287756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.287885 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.288523 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:22.288543 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:22.290027 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:22.291410 (+ 1383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:22.291418 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:22.291420 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:22.291654 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:22.291868 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:22.291869 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:22.291869 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:22.291993 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:22.292268 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:22.292276 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:22.292412 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 06:44:22.292512 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 06:44:22.292679 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260810 06:44:22.293368 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 20649
I20260810 06:44:22.293529 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:44:22.293648 20844 heartbeater.cc:347] Connected to a master server at 127.27.41.190:39763
I20260810 06:44:22.293751 20844 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:22.293772 27814 external_mini_cluster.cc:1428] Setting key 5612ab2b2266f032cbbf45ccba9d6ed5
I20260810 06:44:22.293949 20844 heartbeater.cc:511] Master 127.27.41.190:39763 requested a full tablet report, sending...
I20260810 06:44:22.294410 20374 ts_manager.cc:194] Registered new tserver with Master: 6b956190b82b4a3d82f47813af476582 (127.27.41.130:36551)
I20260810 06:44:22.294919 20374 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:48321
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:44:22.319600 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:39763
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:22.403488 20851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:22.403713 20851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:22.403750 20851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:22.404830 20851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:22.404893 20851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:22.404938 20851 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:44:22.406476 20851 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:39763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:22.406749 20851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:22.406977 20851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:22.412267 20861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:22.412209 20865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:22.412336 20851 server_base.cc:1034] running on GCE node
W20260810 06:44:22.412218 20862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:22.412645 20851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:22.412892 20851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:22.414062 20851 hybrid_clock.cc:648] HybridClock initialized: now 1786344262414049 us; error 50 us; skew 500 ppm
Aug 10 06:44:22 dist-test-slave-bw88 krb5kdc[20310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344262, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:22.416498 20851 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:44:22.416963 20851 webserver.cc:460] Webserver started at http://127.27.41.131:37333/ using document root <none> and password file <none>
I20260810 06:44:22.417224 20851 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:22.417296 20851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:22.417477 20851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:22.418534 20851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "697995058d4d4628907001fa091594a7"
format_stamp: "Formatted at 2026-08-10 06:44:22 on dist-test-slave-bw88"
server_key: "7b2de823faff0cca71adde9c2a507ca9"
server_key_iv: "c197b36c7e407f1152a4420fccb59a56"
server_key_version: "encryptionkey@0"
I20260810 06:44:22.418905 20851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "697995058d4d4628907001fa091594a7"
format_stamp: "Formatted at 2026-08-10 06:44:22 on dist-test-slave-bw88"
server_key: "7b2de823faff0cca71adde9c2a507ca9"
server_key_iv: "c197b36c7e407f1152a4420fccb59a56"
server_key_version: "encryptionkey@0"
I20260810 06:44:22.420266 20851 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:44:22.420987 20873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:22.421178 20851 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:22.421288 20851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "697995058d4d4628907001fa091594a7"
format_stamp: "Formatted at 2026-08-10 06:44:22 on dist-test-slave-bw88"
server_key: "7b2de823faff0cca71adde9c2a507ca9"
server_key_iv: "c197b36c7e407f1152a4420fccb59a56"
server_key_version: "encryptionkey@0"
I20260810 06:44:22.421392 20851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:22.434708 20851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:22.438696 20851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:22.438988 20851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:22.439289 20851 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:22.439790 20851 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:22.439850 20851 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:22.439944 20851 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:22.439998 20851 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:22.461100 20851 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:38139
I20260810 06:44:22.461475 21041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:38139 every 8 connection(s)
I20260810 06:44:22.463917 20851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:44:22.466370 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 20851
I20260810 06:44:22.467175 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:44:22.468199 27814 external_mini_cluster.cc:1428] Setting key 5107c209d0d526e05b87f4b6007a5683
Aug 10 06:44:22 dist-test-slave-bw88 krb5kdc[20310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344262, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:22.512521 20432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.468736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:55003 (local address 127.27.41.190:39763)
0810 06:44:22.468939 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:22.468941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:22.470487 (+ 1546us) server_negotiation.cc:407] Connection header received
0810 06:44:22.473530 (+ 3043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:22.473535 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:22.473586 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:22.473823 (+ 237us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:22.479054 (+ 5231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.481550 (+ 2496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.489426 (+ 7876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.490576 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.490938 (+ 362us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.500369 (+ 9431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:22.500371 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:22.500372 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:22.500405 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:22.507646 (+ 7241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:22.509692 (+ 2046us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:22.509695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:22.509695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:22.509990 (+ 295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:22.510824 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:22.510828 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:22.510828 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:22.511208 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:22.511414 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:22.512083 (+ 669us) server_negotiation.cc:299] Negotiation successful
0810 06:44:22.512265 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260810 06:44:22.512900 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.468914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:39763 (local address 127.27.41.131:55003)
0810 06:44:22.469980 (+ 1066us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:22.470096 (+ 116us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:22.472975 (+ 2879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:22.474161 (+ 1186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:22.474181 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:22.477198 (+ 3017us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:22.478687 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.478708 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.482050 (+ 3342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.482086 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.488943 (+ 6857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.488973 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.490961 (+ 1988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.490966 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.491671 (+ 705us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.494239 (+ 2568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:22.494261 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:22.500018 (+ 5757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:22.508391 (+ 8373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:22.508400 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:22.508403 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:22.509439 (+ 1036us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:22.510214 (+ 775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:22.510214 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:22.510215 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:22.510581 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:22.511408 (+ 827us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:22.511422 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:22.511906 (+ 484us) client_negotiation.cc:769] Sending connection context
0810 06:44:22.512004 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 06:44:22.512368 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":761,"thread_start_us":629,"threads_started":1}
I20260810 06:44:22.514652 21042 heartbeater.cc:347] Connected to a master server at 127.27.41.190:39763
I20260810 06:44:22.515216 21042 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:22.516145 21042 heartbeater.cc:511] Master 127.27.41.190:39763 requested a full tablet report, sending...
I20260810 06:44:22.517468 20374 ts_manager.cc:194] Registered new tserver with Master: 697995058d4d4628907001fa091594a7 (127.27.41.131:38139)
I20260810 06:44:22.518577 20374 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:55003
I20260810 06:44:22.522627 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:44:22.556988 20432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.527569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60536 (local address 127.27.41.190:39763)
0810 06:44:22.527729 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:22.527731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:22.528210 (+ 479us) server_negotiation.cc:407] Connection header received
0810 06:44:22.528413 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:22.528417 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:22.528452 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:22.528601 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:22.530935 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.532352 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.534999 (+ 2647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.535442 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.535840 (+ 398us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.541783 (+ 5943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:22.541798 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:22.541803 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:22.541836 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:22.549934 (+ 8098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:22.552226 (+ 2292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:22.552231 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:22.552231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:22.552450 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:22.553397 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:22.553399 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:22.553399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:22.554258 (+ 859us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:22.554843 (+ 585us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:22.555899 (+ 1056us) server_negotiation.cc:299] Negotiation successful
0810 06:44:22.556331 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260810 06:44:22.560429 20374 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60536:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:44:22.565791 20374 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:44:22.576776 21062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.570145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:40483 (local address 127.0.0.1:57624)
0810 06:44:22.570691 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:22.570798 (+ 107us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:22.570959 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:22.571659 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:22.571662 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:22.571665 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:22.571810 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.571813 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.573471 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.573472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.575213 (+ 1741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.575215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.576497 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.576499 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.576581 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.576608 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 06:44:22.576653 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 06:44:22.576702 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":96,"threads_started":1}
I20260810 06:44:22.576887 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.570657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37712 (local address 127.27.41.131:38139)
0810 06:44:22.571551 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:22.571561 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:22.571616 (+ 55us) server_negotiation.cc:407] Connection header received
0810 06:44:22.571663 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:22.571665 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:22.571677 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:22.571843 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:22.572094 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.574222 (+ 2128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.575762 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.576488 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.576594 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.576664 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:22.576763 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 06:44:22.576803 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":159,"threads_started":1}
I20260810 06:44:22.577142 21058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.570470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:38139 (local address 127.0.0.1:37712)
0810 06:44:22.571131 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:22.571140 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:22.571202 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:22.571841 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:22.571842 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:22.571844 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:22.571925 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.571927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.574442 (+ 2515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.574444 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.575585 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.575588 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.576613 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.576615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.576688 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.576693 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:44:22.576748 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 06:44:22.576791 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"mutex_wait_us":37,"thread_start_us":129,"threads_started":1}
I20260810 06:44:22.577263 21061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.570322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57624 (local address 127.27.41.129:40483)
0810 06:44:22.571180 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:22.571213 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:22.571247 (+ 34us) server_negotiation.cc:407] Connection header received
0810 06:44:22.571342 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:22.571355 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:22.571392 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:22.571654 (+ 262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:22.571972 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.573216 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.575451 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.576400 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.577017 (+ 617us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.577092 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:22.577120 (+ 28us) server_negotiation.cc:299] Negotiation successful
0810 06:44:22.577162 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":812,"thread_start_us":121,"threads_started":1}
I20260810 06:44:22.577533 21060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.570248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:36551 (local address 127.0.0.1:38964)
0810 06:44:22.570691 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:22.570798 (+ 107us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:22.570959 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:22.572379 (+ 1420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:22.572381 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:22.572384 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:22.572453 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.572454 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.574437 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.574438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.576127 (+ 1689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.576130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.577292 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.577293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.577380 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.577384 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:44:22.577417 (+ 33us) client_negotiation.cc:240] Negotiation successful
0810 06:44:22.577452 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":54,"thread_start_us":136,"threads_started":1}
I20260810 06:44:22.577929 21064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.570638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38964 (local address 127.27.41.130:36551)
0810 06:44:22.572083 (+ 1445us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:22.572089 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:22.572112 (+ 23us) server_negotiation.cc:407] Connection header received
0810 06:44:22.572189 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:22.572191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:22.572223 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:22.572337 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:22.572585 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.574290 (+ 1705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.576231 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.577129 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.577717 (+ 588us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.577779 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:22.577806 (+ 27us) server_negotiation.cc:299] Negotiation successful
0810 06:44:22.577845 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1377,"thread_start_us":184,"threads_started":1}
I20260810 06:44:22.577975 20938 tablet_service.cc:1467] Processing CreateTablet for tablet f078b4fee3e2442395765965a8c3eb02 (DEFAULT_TABLE table=test-table [id=59063540f1ef45f69c42affe1d327158]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:22.578029 20546 tablet_service.cc:1467] Processing CreateTablet for tablet f078b4fee3e2442395765965a8c3eb02 (DEFAULT_TABLE table=test-table [id=59063540f1ef45f69c42affe1d327158]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:22.578372 20938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f078b4fee3e2442395765965a8c3eb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:22.578408 20546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f078b4fee3e2442395765965a8c3eb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:22.578555 20744 tablet_service.cc:1467] Processing CreateTablet for tablet f078b4fee3e2442395765965a8c3eb02 (DEFAULT_TABLE table=test-table [id=59063540f1ef45f69c42affe1d327158]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:22.578881 20744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f078b4fee3e2442395765965a8c3eb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:22.580873 21067 tablet_bootstrap.cc:492] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7: Bootstrap starting.
I20260810 06:44:22.581545 21067 tablet_bootstrap.cc:654] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:22.582089 21067 log.cc:824] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:22.582352 21069 tablet_bootstrap.cc:492] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32: Bootstrap starting.
I20260810 06:44:22.582542 21071 tablet_bootstrap.cc:492] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582: Bootstrap starting.
I20260810 06:44:22.582983 21069 tablet_bootstrap.cc:654] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:22.583127 21067 tablet_bootstrap.cc:492] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7: No bootstrap required, opened a new log
I20260810 06:44:22.583195 21067 ts_tablet_manager.cc:1397] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 06:44:22.583246 21071 tablet_bootstrap.cc:654] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:22.583439 21069 log.cc:824] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:22.583809 21071 log.cc:824] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:22.584147 21069 tablet_bootstrap.cc:492] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32: No bootstrap required, opened a new log
I20260810 06:44:22.584209 21069 ts_tablet_manager.cc:1397] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:44:22.584681 21071 tablet_bootstrap.cc:492] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582: No bootstrap required, opened a new log
I20260810 06:44:22.584739 21071 ts_tablet_manager.cc:1397] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:44:22.585292 21067 raft_consensus.cc:348] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5f4afac2efc4ad797c9d0db3a3caa32" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 40483 } } peers { permanent_uuid: "697995058d4d4628907001fa091594a7" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38139 } } peers { permanent_uuid: "6b956190b82b4a3d82f47813af476582" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 36551 } }
I20260810 06:44:22.585515 21067 raft_consensus.cc:374] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:22.585557 21067 raft_consensus.cc:729] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 697995058d4d4628907001fa091594a7, State: Initialized, Role: FOLLOWER
I20260810 06:44:22.585676 21067 consensus_queue.cc:260] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5f4afac2efc4ad797c9d0db3a3caa32" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 40483 } } peers { permanent_uuid: "697995058d4d4628907001fa091594a7" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38139 } } peers { permanent_uuid: "6b956190b82b4a3d82f47813af476582" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 36551 } }
I20260810 06:44:22.585798 21069 raft_consensus.cc:348] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5f4afac2efc4ad797c9d0db3a3caa32" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 40483 } } peers { permanent_uuid: "697995058d4d4628907001fa091594a7" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38139 } } peers { permanent_uuid: "6b956190b82b4a3d82f47813af476582" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 36551 } }
I20260810 06:44:22.585942 21067 ts_tablet_manager.cc:1428] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260810 06:44:22.585979 21069 raft_consensus.cc:374] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:22.586073 21042 heartbeater.cc:503] Master 127.27.41.190:39763 was elected leader, sending a full tablet report...
I20260810 06:44:22.586361 21069 raft_consensus.cc:729] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5f4afac2efc4ad797c9d0db3a3caa32, State: Initialized, Role: FOLLOWER
I20260810 06:44:22.586522 21069 consensus_queue.cc:260] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5f4afac2efc4ad797c9d0db3a3caa32" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 40483 } } peers { permanent_uuid: "697995058d4d4628907001fa091594a7" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38139 } } peers { permanent_uuid: "6b956190b82b4a3d82f47813af476582" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 36551 } }
I20260810 06:44:22.586839 20641 heartbeater.cc:503] Master 127.27.41.190:39763 was elected leader, sending a full tablet report...
I20260810 06:44:22.586849 21071 raft_consensus.cc:348] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5f4afac2efc4ad797c9d0db3a3caa32" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 40483 } } peers { permanent_uuid: "697995058d4d4628907001fa091594a7" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38139 } } peers { permanent_uuid: "6b956190b82b4a3d82f47813af476582" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 36551 } }
I20260810 06:44:22.587025 21071 raft_consensus.cc:374] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:22.587100 21071 raft_consensus.cc:729] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b956190b82b4a3d82f47813af476582, State: Initialized, Role: FOLLOWER
I20260810 06:44:22.586833 21069 ts_tablet_manager.cc:1428] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:44:22.587234 21071 consensus_queue.cc:260] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5f4afac2efc4ad797c9d0db3a3caa32" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 40483 } } peers { permanent_uuid: "697995058d4d4628907001fa091594a7" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38139 } } peers { permanent_uuid: "6b956190b82b4a3d82f47813af476582" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 36551 } }
I20260810 06:44:22.587512 21071 ts_tablet_manager.cc:1428] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:44:22.587667 20844 heartbeater.cc:503] Master 127.27.41.190:39763 was elected leader, sending a full tablet report...
W20260810 06:44:22.629638 20642 tablet.cc:2369] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:44:22.686326 21076 raft_consensus.cc:482] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:44:22.686473 21076 raft_consensus.cc:504] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5f4afac2efc4ad797c9d0db3a3caa32" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 40483 } } peers { permanent_uuid: "697995058d4d4628907001fa091594a7" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38139 } } peers { permanent_uuid: "6b956190b82b4a3d82f47813af476582" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 36551 } }
I20260810 06:44:22.686931 21076 leader_election.cc:288] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5f4afac2efc4ad797c9d0db3a3caa32 (127.27.41.129:40483), 6b956190b82b4a3d82f47813af476582 (127.27.41.130:36551)
I20260810 06:44:22.690933 21064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.687194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:51329 (local address 127.27.41.130:36551)
0810 06:44:22.687244 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:22.687247 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:22.687304 (+ 57us) server_negotiation.cc:407] Connection header received
0810 06:44:22.687399 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:22.687400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:22.687409 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:22.687494 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:22.687706 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.688488 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.689989 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.690555 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.690639 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.690648 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:22.690820 (+ 172us) server_negotiation.cc:299] Negotiation successful
0810 06:44:22.690860 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 06:44:22.690933 21061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.687226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:38749 (local address 127.27.41.129:40483)
0810 06:44:22.687270 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:22.687272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:22.687476 (+ 204us) server_negotiation.cc:407] Connection header received
0810 06:44:22.687529 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:22.687530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:22.687540 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:22.687590 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:22.687763 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.688491 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.689990 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.690555 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.690639 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.690648 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:22.690820 (+ 172us) server_negotiation.cc:299] Negotiation successful
0810 06:44:22.690860 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 06:44:22.690943 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.687161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:36551 (local address 127.27.41.131:51329)
0810 06:44:22.687233 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:22.687244 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:22.687318 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:22.687514 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:22.687515 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:22.687517 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:22.687621 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.687623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.688580 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.688581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.689896 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.689900 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.690653 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.690653 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.690737 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.690739 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:44:22.690797 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 06:44:22.690844 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":18}
I20260810 06:44:22.690951 21082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.687166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:40483 (local address 127.27.41.131:38749)
0810 06:44:22.687387 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:22.687398 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:22.687450 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:22.687610 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:22.687611 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:22.687612 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:22.687687 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.687688 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.688580 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.688581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.689896 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:22.689900 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.690653 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.690653 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:22.690733 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.690738 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:44:22.690797 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 06:44:22.690844 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":118,"thread_start_us":130,"threads_started":1}
I20260810 06:44:22.691330 20777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f078b4fee3e2442395765965a8c3eb02" candidate_uuid: "697995058d4d4628907001fa091594a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b956190b82b4a3d82f47813af476582" is_pre_election: true
I20260810 06:44:22.691501 20777 raft_consensus.cc:2454] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 697995058d4d4628907001fa091594a7 in term 0.
I20260810 06:44:22.691632 20578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f078b4fee3e2442395765965a8c3eb02" candidate_uuid: "697995058d4d4628907001fa091594a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5f4afac2efc4ad797c9d0db3a3caa32" is_pre_election: true
I20260810 06:44:22.691756 20578 raft_consensus.cc:2454] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 697995058d4d4628907001fa091594a7 in term 0.
I20260810 06:44:22.691972 20876 leader_election.cc:302] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 697995058d4d4628907001fa091594a7, 6b956190b82b4a3d82f47813af476582; no voters:
I20260810 06:44:22.692129 21076 raft_consensus.cc:2781] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:44:22.692188 21076 raft_consensus.cc:482] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:44:22.692204 21076 raft_consensus.cc:3037] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:22.693020 21076 raft_consensus.cc:504] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5f4afac2efc4ad797c9d0db3a3caa32" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 40483 } } peers { permanent_uuid: "697995058d4d4628907001fa091594a7" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38139 } } peers { permanent_uuid: "6b956190b82b4a3d82f47813af476582" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 36551 } }
I20260810 06:44:22.693140 21076 leader_election.cc:288] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [CANDIDATE]: Term 1 election: Requested vote from peers f5f4afac2efc4ad797c9d0db3a3caa32 (127.27.41.129:40483), 6b956190b82b4a3d82f47813af476582 (127.27.41.130:36551)
I20260810 06:44:22.693329 20578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f078b4fee3e2442395765965a8c3eb02" candidate_uuid: "697995058d4d4628907001fa091594a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5f4afac2efc4ad797c9d0db3a3caa32"
I20260810 06:44:22.693425 20777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f078b4fee3e2442395765965a8c3eb02" candidate_uuid: "697995058d4d4628907001fa091594a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b956190b82b4a3d82f47813af476582"
I20260810 06:44:22.693444 20578 raft_consensus.cc:3037] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:22.693518 20777 raft_consensus.cc:3037] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:22.694207 20578 raft_consensus.cc:2454] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 697995058d4d4628907001fa091594a7 in term 1.
I20260810 06:44:22.694329 20777 raft_consensus.cc:2454] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 697995058d4d4628907001fa091594a7 in term 1.
I20260810 06:44:22.694388 20875 leader_election.cc:302] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 697995058d4d4628907001fa091594a7, f5f4afac2efc4ad797c9d0db3a3caa32; no voters:
I20260810 06:44:22.694512 21076 raft_consensus.cc:2781] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:22.694695 21076 raft_consensus.cc:686] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [term 1 LEADER]: Becoming Leader. State: Replica: 697995058d4d4628907001fa091594a7, State: Running, Role: LEADER
I20260810 06:44:22.694815 21076 consensus_queue.cc:237] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5f4afac2efc4ad797c9d0db3a3caa32" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 40483 } } peers { permanent_uuid: "697995058d4d4628907001fa091594a7" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38139 } } peers { permanent_uuid: "6b956190b82b4a3d82f47813af476582" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 36551 } }
I20260810 06:44:22.695631 20376 catalog_manager.cc:5495] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 697995058d4d4628907001fa091594a7 (127.27.41.131). New cstate: current_term: 1 leader_uuid: "697995058d4d4628907001fa091594a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5f4afac2efc4ad797c9d0db3a3caa32" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 40483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "697995058d4d4628907001fa091594a7" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 38139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b956190b82b4a3d82f47813af476582" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 36551 } health_report { overall_health: UNKNOWN } } }
W20260810 06:44:22.717733 21045 tablet.cc:2369] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:44:22.722942 21063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.720705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37718 (local address 127.27.41.131:38139)
0810 06:44:22.720762 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:22.720764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:22.720779 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:44:22.720812 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:22.720813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:22.720829 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:22.720901 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:22.721037 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.721527 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.722264 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.722447 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.722500 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.722656 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:22.722744 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:22.722817 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:22.722864 (+ 47us) server_negotiation.cc:299] Negotiation successful
0810 06:44:22.722875 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 06:44:22.724761 20578 raft_consensus.cc:1261] T f078b4fee3e2442395765965a8c3eb02 P f5f4afac2efc4ad797c9d0db3a3caa32 [term 1 FOLLOWER]: Refusing update from remote peer 697995058d4d4628907001fa091594a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:22.724781 20777 raft_consensus.cc:1261] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582 [term 1 FOLLOWER]: Refusing update from remote peer 697995058d4d4628907001fa091594a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:22.725178 21076 consensus_queue.cc:1035] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5f4afac2efc4ad797c9d0db3a3caa32" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 40483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:22.725359 21084 consensus_queue.cc:1035] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b956190b82b4a3d82f47813af476582" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 36551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:22.727896 21088 mvcc.cc:205] Tried to move back new op lower bound from 7316866100117831680 to 7316866099998613504. Current Snapshot: MvccSnapshot[applied={T|T < 7316866100117831680}]
I20260810 06:44:22.728253 21091 mvcc.cc:205] Tried to move back new op lower bound from 7316866100117831680 to 7316866099998613504. Current Snapshot: MvccSnapshot[applied={T|T < 7316866100117831680}]
I20260810 06:44:22.730144 20376 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:44:22.730230 20376 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:44:22.731011 20376 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 55d3e3d94b124303a7bce5b89b230a81: Sending DeleteTablet for 3 replicas of tablet f078b4fee3e2442395765965a8c3eb02
I20260810 06:44:22.731343 20938 tablet_service.cc:1514] Processing DeleteTablet for tablet f078b4fee3e2442395765965a8c3eb02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:22 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:37712
I20260810 06:44:22.731383 20546 tablet_service.cc:1514] Processing DeleteTablet for tablet f078b4fee3e2442395765965a8c3eb02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:22 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:57624
I20260810 06:44:22.731366 20744 tablet_service.cc:1514] Processing DeleteTablet for tablet f078b4fee3e2442395765965a8c3eb02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:22 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:38964
I20260810 06:44:22.731696 21100 tablet_replica.cc:330] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582: stopping tablet replica
I20260810 06:44:22.731716 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 20460
I20260810 06:44:22.739019 21099 tablet_replica.cc:330] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7: stopping tablet replica
I20260810 06:44:22.739210 21100 raft_consensus.cc:2229] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:44:22.739341 21100 raft_consensus.cc:2258] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:44:22.739456 21099 raft_consensus.cc:2229] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:44:22.739615 21099 raft_consensus.cc:2258] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:44:22.740749 21100 ts_tablet_manager.cc:1905] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:44:22.741652 21099 ts_tablet_manager.cc:1905] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:44:22.743005 21100 ts_tablet_manager.cc:1918] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:44:22.743098 21100 log.cc:1196] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/f078b4fee3e2442395765965a8c3eb02
I20260810 06:44:22.743371 21099 ts_tablet_manager.cc:1918] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:44:22.743402 21100 ts_tablet_manager.cc:1939] T f078b4fee3e2442395765965a8c3eb02 P 6b956190b82b4a3d82f47813af476582: Deleting consensus metadata
I20260810 06:44:22.743456 21099 log.cc:1196] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/f078b4fee3e2442395765965a8c3eb02
I20260810 06:44:22.743741 21099 ts_tablet_manager.cc:1939] T f078b4fee3e2442395765965a8c3eb02 P 697995058d4d4628907001fa091594a7: Deleting consensus metadata
I20260810 06:44:22.743873 20356 catalog_manager.cc:4841] TS 6b956190b82b4a3d82f47813af476582 (127.27.41.130:36551): tablet f078b4fee3e2442395765965a8c3eb02 (table test-table [id=59063540f1ef45f69c42affe1d327158]) successfully deleted
I20260810 06:44:22.744132 20355 catalog_manager.cc:4841] TS 697995058d4d4628907001fa091594a7 (127.27.41.131:38139): tablet f078b4fee3e2442395765965a8c3eb02 (table test-table [id=59063540f1ef45f69c42affe1d327158]) successfully deleted
W20260810 06:44:22.749712 20355 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:40483 (error 108)
I20260810 06:44:22.750027 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 20649
I20260810 06:44:22.750241 21060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.750115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:40483 (local address 127.0.0.1:57640)
0810 06:44:22.750170 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:22.750203 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:40483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 06:44:22.755059 20355 catalog_manager.cc:4584] TS f5f4afac2efc4ad797c9d0db3a3caa32 (127.27.41.129:40483): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f078b4fee3e2442395765965a8c3eb02: Network error: Client connection negotiation failed: client connection to 127.27.41.129:40483: connect: Connection refused (error 111)
I20260810 06:44:22.759915 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 20851
I20260810 06:44:22.771101 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 20333
2026-08-10T06:44:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2270 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-10T06:44:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:22Z Disabled control of system clock
I20260810 06:44:22.805102 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38953
--webserver_interface=127.27.41.190
--webserver_port=0
--builtin_ntp_servers=127.27.41.148:43179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:38953
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 06:44:22.886104 21107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:22.886303 21107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:22.886323 21107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:22.887344 21107 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:22.887377 21107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:22.887389 21107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:22.887413 21107 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:22.887424 21107 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:22.888650 21107 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:43179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:38953
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:22.888828 21107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:22.889102 21107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:22.893949 21120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:22.894017 21114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:22.893939 21113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:22.894109 21107 server_base.cc:1034] running on GCE node
I20260810 06:44:22.894387 21107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:22.894714 21107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:22.895903 21107 hybrid_clock.cc:648] HybridClock initialized: now 1786344262895890 us; error 43 us; skew 500 ppm
I20260810 06:44:22.897322 21107 webserver.cc:460] Webserver started at http://127.27.41.190:39523/ using document root <none> and password file <none>
I20260810 06:44:22.897635 21107 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:22.897706 21107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:22.897866 21107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:22.898867 21107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "fab5a97209334427bfc71c5b0d639571"
format_stamp: "Formatted at 2026-08-10 06:44:22 on dist-test-slave-bw88"
server_key: "7eab7c97be417f475c75dd71ac772fa3"
server_key_iv: "acdebc9f1abd6398037c7db7d123f54b"
server_key_version: "encryptionkey@0"
I20260810 06:44:22.899233 21107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "fab5a97209334427bfc71c5b0d639571"
format_stamp: "Formatted at 2026-08-10 06:44:22 on dist-test-slave-bw88"
server_key: "7eab7c97be417f475c75dd71ac772fa3"
server_key_iv: "acdebc9f1abd6398037c7db7d123f54b"
server_key_version: "encryptionkey@0"
I20260810 06:44:22.900542 21107 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:44:22.901257 21132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:22.901434 21107 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:22.901527 21107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "fab5a97209334427bfc71c5b0d639571"
format_stamp: "Formatted at 2026-08-10 06:44:22 on dist-test-slave-bw88"
server_key: "7eab7c97be417f475c75dd71ac772fa3"
server_key_iv: "acdebc9f1abd6398037c7db7d123f54b"
server_key_version: "encryptionkey@0"
I20260810 06:44:22.901612 21107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:22.912739 21107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:22.913022 21107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:22.913175 21107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:22.917029 21107 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:38953
I20260810 06:44:22.917107 21210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:38953 every 8 connection(s)
I20260810 06:44:22.917547 21107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:22.918553 21212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:22.919708 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 21107
I20260810 06:44:22.919831 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:22.920028 27814 external_mini_cluster.cc:1428] Setting key 548156bd946b556d765ff75b865d0589
I20260810 06:44:22.921505 21212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571: Bootstrap starting.
I20260810 06:44:22.922148 21212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:22.922449 21212 log.cc:824] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:22.923189 21212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571: No bootstrap required, opened a new log
I20260810 06:44:22.924911 21212 raft_consensus.cc:348] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fab5a97209334427bfc71c5b0d639571" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38953 } }
I20260810 06:44:22.925066 21212 raft_consensus.cc:374] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:22.925137 21212 raft_consensus.cc:729] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab5a97209334427bfc71c5b0d639571, State: Initialized, Role: FOLLOWER
I20260810 06:44:22.925298 21212 consensus_queue.cc:260] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fab5a97209334427bfc71c5b0d639571" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38953 } }
I20260810 06:44:22.925436 21212 raft_consensus.cc:388] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:22.925495 21212 raft_consensus.cc:482] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:22.925544 21212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:22.925594 21217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:22.920577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53870 (local address 127.27.41.190:38953)
0810 06:44:22.920768 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:22.920778 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:22.920807 (+ 29us) server_negotiation.cc:407] Connection header received
0810 06:44:22.921231 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:22.921237 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:22.921296 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:22.921473 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:22.921706 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.922651 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.923527 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:22.923939 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:22.924074 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:22.924785 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:22.924793 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:22.924794 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:22.924949 (+ 155us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:22.924985 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:22.924995 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:22.925065 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:22.925207 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 06:44:22.925288 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":93,"threads_started":1}
I20260810 06:44:22.926189 21212 raft_consensus.cc:504] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fab5a97209334427bfc71c5b0d639571" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38953 } }
I20260810 06:44:22.926306 21212 leader_election.cc:302] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fab5a97209334427bfc71c5b0d639571; no voters:
I20260810 06:44:22.926435 21212 leader_election.cc:288] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:22.926515 21219 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:22.926662 21219 raft_consensus.cc:686] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [term 1 LEADER]: Becoming Leader. State: Replica: fab5a97209334427bfc71c5b0d639571, State: Running, Role: LEADER
I20260810 06:44:22.926697 21212 sys_catalog.cc:564] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:22.926776 21219 consensus_queue.cc:237] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fab5a97209334427bfc71c5b0d639571" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38953 } }
I20260810 06:44:22.927155 21222 sys_catalog.cc:455] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fab5a97209334427bfc71c5b0d639571. Latest consensus state: current_term: 1 leader_uuid: "fab5a97209334427bfc71c5b0d639571" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fab5a97209334427bfc71c5b0d639571" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38953 } } }
I20260810 06:44:22.927282 21222 sys_catalog.cc:458] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:22.927148 21220 sys_catalog.cc:455] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fab5a97209334427bfc71c5b0d639571" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fab5a97209334427bfc71c5b0d639571" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38953 } } }
I20260810 06:44:22.927409 21220 sys_catalog.cc:458] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:22.927881 21236 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:22.928414 21236 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:22.929906 21236 catalog_manager.cc:1347] Generated new cluster ID: cb735627bc8345d08a3f9b90f942df0f
I20260810 06:44:22.929955 21236 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:22.945803 21236 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:22.946485 21236 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:22.960088 21236 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571: Generated new TSK 0
I20260810 06:44:22.960271 21236 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:22.963862 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38953
--builtin_ntp_servers=127.27.41.148:43179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 06:44:23.048408 21248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:23.048646 21248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:23.048686 21248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:23.049877 21248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:23.049950 21248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:23.049995 21248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:44:23.051339 21248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:43179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:23.051600 21248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:23.051975 21248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:23.058017 21263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:23.058111 21261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:23.058172 21259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:23.058400 21248 server_base.cc:1034] running on GCE node
I20260810 06:44:23.058627 21248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:23.058924 21248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:23.060092 21248 hybrid_clock.cc:648] HybridClock initialized: now 1786344263060094 us; error 45 us; skew 500 ppm
I20260810 06:44:23.061430 21248 webserver.cc:460] Webserver started at http://127.27.41.129:45985/ using document root <none> and password file <none>
I20260810 06:44:23.061685 21248 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:23.061733 21248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:23.061870 21248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:23.062945 21248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4"
format_stamp: "Formatted at 2026-08-10 06:44:23 on dist-test-slave-bw88"
server_key: "66aafbf02c0d297350234d85c1118e48"
server_key_iv: "ee275efcd5429e94cb207131ffd62f3b"
server_key_version: "encryptionkey@0"
I20260810 06:44:23.063313 21248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4"
format_stamp: "Formatted at 2026-08-10 06:44:23 on dist-test-slave-bw88"
server_key: "66aafbf02c0d297350234d85c1118e48"
server_key_iv: "ee275efcd5429e94cb207131ffd62f3b"
server_key_version: "encryptionkey@0"
I20260810 06:44:23.064666 21248 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:44:23.065436 21274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:23.065635 21248 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:44:23.065739 21248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4"
format_stamp: "Formatted at 2026-08-10 06:44:23 on dist-test-slave-bw88"
server_key: "66aafbf02c0d297350234d85c1118e48"
server_key_iv: "ee275efcd5429e94cb207131ffd62f3b"
server_key_version: "encryptionkey@0"
I20260810 06:44:23.065824 21248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:23.087728 21248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:23.088102 21248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:23.088263 21248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:23.088553 21248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:23.088970 21248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:23.089026 21248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:23.089061 21248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:23.089083 21248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:23.095901 21248 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:41363
I20260810 06:44:23.095937 21432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:41363 every 8 connection(s)
I20260810 06:44:23.096310 21248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:44:23.099630 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 21248
I20260810 06:44:23.099745 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:44:23.099949 27814 external_mini_cluster.cc:1428] Setting key 4c80d1da062703597a0967afeb3ba462
I20260810 06:44:23.100965 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38953
--builtin_ntp_servers=127.27.41.148:43179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 06:44:23.102237 21217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.097087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:50225 (local address 127.27.41.190:38953)
0810 06:44:23.097130 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:23.097132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:23.097384 (+ 252us) server_negotiation.cc:407] Connection header received
0810 06:44:23.097957 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:23.097958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:23.097972 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:23.098019 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:23.098743 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.099253 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.100695 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.100896 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.100983 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.101944 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:23.101946 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:23.101946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:23.101952 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:23.101968 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:23.101977 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:23.102046 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:23.102132 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 06:44:23.102158 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:44:23.102463 21435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.097066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38953 (local address 127.27.41.129:50225)
0810 06:44:23.097241 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:23.097275 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:23.097838 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:23.098107 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:23.098110 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:23.098118 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:23.098635 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.098639 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.099361 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.099364 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.100588 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.100591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.100996 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.100997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.101171 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.101802 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:44:23.101803 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:23.101831 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:44:23.101853 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:23.102051 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:23.102059 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:23.102062 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:44:23.102133 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 06:44:23.102236 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":73,"threads_started":1}
I20260810 06:44:23.103255 21433 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38953
I20260810 06:44:23.103369 21433 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:23.103546 21433 heartbeater.cc:511] Master 127.27.41.190:38953 requested a full tablet report, sending...
I20260810 06:44:23.104166 21156 ts_manager.cc:194] Registered new tserver with Master: 13eaa3f3901c4cc1b0ff745026c3cdf4 (127.27.41.129:41363)
I20260810 06:44:23.104794 21156 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.41.129:50225
W20260810 06:44:23.184876 21436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:23.185127 21436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:23.185163 21436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:23.186345 21436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:23.186409 21436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:23.186450 21436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:44:23.187794 21436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:43179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:23.188057 21436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:23.188344 21436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:23.193616 21447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:23.193625 21444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:23.193610 21449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:23.193610 21436 server_base.cc:1034] running on GCE node
I20260810 06:44:23.194042 21436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:23.194325 21436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:23.195488 21436 hybrid_clock.cc:648] HybridClock initialized: now 1786344263195483 us; error 37 us; skew 500 ppm
I20260810 06:44:23.196720 21436 webserver.cc:460] Webserver started at http://127.27.41.130:40277/ using document root <none> and password file <none>
I20260810 06:44:23.196969 21436 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:23.197041 21436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:23.197186 21436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:23.198298 21436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "bcd443570efb48e4b92d95dae8683b0f"
format_stamp: "Formatted at 2026-08-10 06:44:23 on dist-test-slave-bw88"
server_key: "27bfe52a1dfa7fffa64eb4628111ffd3"
server_key_iv: "612af46e67a88c5cd1fb2b2a76599b9a"
server_key_version: "encryptionkey@0"
I20260810 06:44:23.198676 21436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "bcd443570efb48e4b92d95dae8683b0f"
format_stamp: "Formatted at 2026-08-10 06:44:23 on dist-test-slave-bw88"
server_key: "27bfe52a1dfa7fffa64eb4628111ffd3"
server_key_iv: "612af46e67a88c5cd1fb2b2a76599b9a"
server_key_version: "encryptionkey@0"
I20260810 06:44:23.199975 21436 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:44:23.200690 21457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:23.200878 21436 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:23.200979 21436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "bcd443570efb48e4b92d95dae8683b0f"
format_stamp: "Formatted at 2026-08-10 06:44:23 on dist-test-slave-bw88"
server_key: "27bfe52a1dfa7fffa64eb4628111ffd3"
server_key_iv: "612af46e67a88c5cd1fb2b2a76599b9a"
server_key_version: "encryptionkey@0"
I20260810 06:44:23.201062 21436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:23.228164 21436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:23.228513 21436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:23.228693 21436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:23.228992 21436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:23.229383 21436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:23.229442 21436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:23.229477 21436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:23.229506 21436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:23.235368 21436 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:44605
I20260810 06:44:23.235415 21621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:44605 every 8 connection(s)
I20260810 06:44:23.235749 21436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:44:23.237833 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 21436
I20260810 06:44:23.237959 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:44:23.238201 27814 external_mini_cluster.cc:1428] Setting key 0d95cf0037d055d58c649e48ab3bd5f9
I20260810 06:44:23.239305 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38953
--builtin_ntp_servers=127.27.41.148:43179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 06:44:23.241976 21217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.236463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:48273 (local address 127.27.41.190:38953)
0810 06:44:23.236529 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:23.236531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:23.236744 (+ 213us) server_negotiation.cc:407] Connection header received
0810 06:44:23.237310 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:23.237311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:23.237325 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:23.237392 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:23.238413 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.239046 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.240472 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.240654 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.240709 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.241707 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:23.241709 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:23.241710 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:23.241714 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:23.241730 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:23.241734 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:23.241791 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:23.241871 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 06:44:23.241898 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 06:44:23.242215 21625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.236428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38953 (local address 127.27.41.130:48273)
0810 06:44:23.236619 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:23.236654 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:23.237192 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:23.237477 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:23.237488 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:23.237497 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:23.238227 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.238236 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.239146 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.239148 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.240383 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.240386 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.240738 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.240739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.240896 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.241565 (+ 669us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:44:23.241565 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:23.241594 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:44:23.241616 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:23.241794 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:23.241799 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:23.241802 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:44:23.241874 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 06:44:23.241974 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":74,"threads_started":1}
I20260810 06:44:23.242684 21623 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38953
I20260810 06:44:23.242774 21623 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:23.242969 21623 heartbeater.cc:511] Master 127.27.41.190:38953 requested a full tablet report, sending...
I20260810 06:44:23.243373 21156 ts_manager.cc:194] Registered new tserver with Master: bcd443570efb48e4b92d95dae8683b0f (127.27.41.130:44605)
I20260810 06:44:23.243932 21156 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.41.130:48273
W20260810 06:44:23.322629 21626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:23.322813 21626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:23.322834 21626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:23.323866 21626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:23.323895 21626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:23.323920 21626 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:44:23.325189 21626 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:43179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:38953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:23.325425 21626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:23.325665 21626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:23.330914 21639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:23.330951 21641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:23.330953 21638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:23.331065 21626 server_base.cc:1034] running on GCE node
I20260810 06:44:23.331362 21626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:23.331629 21626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:23.332779 21626 hybrid_clock.cc:648] HybridClock initialized: now 1786344263332757 us; error 35 us; skew 500 ppm
I20260810 06:44:23.334051 21626 webserver.cc:460] Webserver started at http://127.27.41.131:46035/ using document root <none> and password file <none>
I20260810 06:44:23.334304 21626 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:23.334373 21626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:23.334529 21626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:23.335599 21626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b"
format_stamp: "Formatted at 2026-08-10 06:44:23 on dist-test-slave-bw88"
server_key: "d13f8dbc0057716c20ae199c215f7bf1"
server_key_iv: "8266afe005a33290d9899b041ccb652f"
server_key_version: "encryptionkey@0"
I20260810 06:44:23.335968 21626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b"
format_stamp: "Formatted at 2026-08-10 06:44:23 on dist-test-slave-bw88"
server_key: "d13f8dbc0057716c20ae199c215f7bf1"
server_key_iv: "8266afe005a33290d9899b041ccb652f"
server_key_version: "encryptionkey@0"
I20260810 06:44:23.337267 21626 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:44:23.338088 21647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:23.338285 21626 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:44:23.338384 21626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b"
format_stamp: "Formatted at 2026-08-10 06:44:23 on dist-test-slave-bw88"
server_key: "d13f8dbc0057716c20ae199c215f7bf1"
server_key_iv: "8266afe005a33290d9899b041ccb652f"
server_key_version: "encryptionkey@0"
I20260810 06:44:23.338464 21626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:23.348517 21626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:23.348798 21626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:23.348944 21626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:23.349164 21626 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:23.349545 21626 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:23.349599 21626 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:23.349630 21626 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:23.349658 21626 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:23.355654 21626 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:36007
I20260810 06:44:23.355806 21803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:36007 every 8 connection(s)
I20260810 06:44:23.356112 21626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:44:23.361727 21217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.357006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:49825 (local address 127.27.41.190:38953)
0810 06:44:23.357084 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:23.357086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:23.357327 (+ 241us) server_negotiation.cc:407] Connection header received
0810 06:44:23.358060 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:23.358061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:23.358082 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:23.358146 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:23.358969 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.359565 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.360498 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.360677 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.360726 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.361521 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:23.361522 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:23.361522 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:23.361526 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:23.361543 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:23.361548 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:23.361598 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:23.361648 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 06:44:23.361670 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 06:44:23.361972 21807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.356980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:38953 (local address 127.27.41.131:49825)
0810 06:44:23.357198 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:23.357242 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:23.357938 (+ 696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:23.358229 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:23.358233 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:23.358249 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:23.358859 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.358868 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.359654 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.359655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.360424 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.360426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.360748 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.360748 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.360851 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.361374 (+ 523us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:44:23.361374 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:23.361413 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:44:23.361445 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:23.361600 (+ 155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:23.361603 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:23.361605 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:44:23.361650 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 06:44:23.361725 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":87,"threads_started":1}
I20260810 06:44:23.362563 21804 heartbeater.cc:347] Connected to a master server at 127.27.41.190:38953
I20260810 06:44:23.362645 21804 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:23.362779 21804 heartbeater.cc:511] Master 127.27.41.190:38953 requested a full tablet report, sending...
I20260810 06:44:23.363112 21156 ts_manager.cc:194] Registered new tserver with Master: 5d63c4d52d5d4dab8b37c5e72cd6697b (127.27.41.131:36007)
I20260810 06:44:23.363440 21156 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.41.131:49825
I20260810 06:44:23.365891 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 21626
I20260810 06:44:23.366046 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:44:23.366255 27814 external_mini_cluster.cc:1428] Setting key fb15a7962a7d5b460a8433b60b7551db
I20260810 06:44:23.367072 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:44:23.371533 21217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.368438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53876 (local address 127.27.41.190:38953)
0810 06:44:23.368515 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:23.368517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:23.368634 (+ 117us) server_negotiation.cc:407] Connection header received
0810 06:44:23.368709 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:23.368710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:23.368720 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:23.368788 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:23.368990 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.369513 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.370267 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.370464 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.370547 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.371245 (+ 698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:23.371246 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:23.371247 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:23.371251 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:23.371264 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:23.371267 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:23.371376 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:23.371445 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 06:44:23.371454 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:44:23.372942 21156 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53876:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:44:23.374547 21156 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:44:23.380673 21824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.376976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42612 (local address 127.27.41.131:36007)
0810 06:44:23.377172 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:23.377176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:23.377186 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:44:23.377221 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:23.377223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:23.377236 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:23.377316 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:23.377613 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.378686 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.379784 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.380262 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.380353 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.380442 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:23.380554 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 06:44:23.380593 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":99,"threads_started":1}
I20260810 06:44:23.380663 21821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.376795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:36007 (local address 127.0.0.1:42612)
0810 06:44:23.376921 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:23.376932 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:23.376983 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:23.377484 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:23.377485 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:23.377486 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:23.377518 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.377519 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.378788 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.378789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.379693 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.379696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.380355 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.380356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.380438 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.380451 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 06:44:23.380528 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 06:44:23.380592 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":26,"thread_start_us":65,"threads_started":1}
I20260810 06:44:23.380750 21816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.376564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:41363 (local address 127.0.0.1:59044)
0810 06:44:23.376769 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:23.376810 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:23.376879 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:23.377213 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:23.377216 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:23.377218 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:23.377285 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.377287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.378339 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.378340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.379591 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.379594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.380515 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.380516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.380592 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.380598 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:44:23.380632 (+ 34us) client_negotiation.cc:240] Negotiation successful
0810 06:44:23.380679 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":71,"threads_started":1}
I20260810 06:44:23.380890 21815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.376603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:44605 (local address 127.0.0.1:43008)
0810 06:44:23.376825 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:23.376836 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:23.376881 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:23.377321 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:23.377322 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:23.377324 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:23.377398 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.377400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.378746 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.378747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.379811 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.379813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.380704 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.380705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.380765 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.380769 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:44:23.380799 (+ 30us) client_negotiation.cc:240] Negotiation successful
0810 06:44:23.380839 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"mutex_wait_us":3,"thread_start_us":95,"threads_started":1}
I20260810 06:44:23.381085 21819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.376663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59044 (local address 127.27.41.129:41363)
0810 06:44:23.377027 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:23.377031 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:23.377039 (+ 8us) server_negotiation.cc:407] Connection header received
0810 06:44:23.377073 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:23.377093 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:23.377110 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:23.377191 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:23.377394 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.378247 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.379692 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.380405 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.380843 (+ 438us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.380940 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:23.380967 (+ 27us) server_negotiation.cc:299] Negotiation successful
0810 06:44:23.381007 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":77,"threads_started":1}
I20260810 06:44:23.381255 21820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.376718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43008 (local address 127.27.41.130:44605)
0810 06:44:23.377112 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:23.377117 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:23.377127 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:44:23.377167 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:23.377169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:23.377185 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:23.377296 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:23.377468 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.378651 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.379897 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.380616 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.380997 (+ 381us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.381093 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:23.381118 (+ 25us) server_negotiation.cc:299] Negotiation successful
0810 06:44:23.381173 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":94,"threads_started":1}
I20260810 06:44:23.381970 21528 tablet_service.cc:1467] Processing CreateTablet for tablet deecd9cc521b4438a13454988845402d (DEFAULT_TABLE table=test-table [id=e73f1ebbeba84929a40f093dc81de296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:23.381959 21338 tablet_service.cc:1467] Processing CreateTablet for tablet deecd9cc521b4438a13454988845402d (DEFAULT_TABLE table=test-table [id=e73f1ebbeba84929a40f093dc81de296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:23.382035 21717 tablet_service.cc:1467] Processing CreateTablet for tablet deecd9cc521b4438a13454988845402d (DEFAULT_TABLE table=test-table [id=e73f1ebbeba84929a40f093dc81de296]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:23.382366 21717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deecd9cc521b4438a13454988845402d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:23.382367 21528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deecd9cc521b4438a13454988845402d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:23.382380 21338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deecd9cc521b4438a13454988845402d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:23.385139 21825 tablet_bootstrap.cc:492] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4: Bootstrap starting.
I20260810 06:44:23.385706 21826 tablet_bootstrap.cc:492] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f: Bootstrap starting.
I20260810 06:44:23.385888 21825 tablet_bootstrap.cc:654] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:23.385936 21827 tablet_bootstrap.cc:492] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b: Bootstrap starting.
I20260810 06:44:23.386253 21825 log.cc:824] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:23.386600 21827 tablet_bootstrap.cc:654] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:23.386963 21827 log.cc:824] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:23.387151 21825 tablet_bootstrap.cc:492] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4: No bootstrap required, opened a new log
I20260810 06:44:23.387226 21825 ts_tablet_manager.cc:1397] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:44:23.387710 21827 tablet_bootstrap.cc:492] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b: No bootstrap required, opened a new log
I20260810 06:44:23.387790 21827 ts_tablet_manager.cc:1397] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:44:23.387856 21826 tablet_bootstrap.cc:654] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:23.388290 21826 log.cc:824] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:23.389832 21825 raft_consensus.cc:348] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41363 } } peers { permanent_uuid: "bcd443570efb48e4b92d95dae8683b0f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44605 } } peers { permanent_uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 36007 } }
I20260810 06:44:23.389984 21825 raft_consensus.cc:374] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:23.390034 21826 tablet_bootstrap.cc:492] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f: No bootstrap required, opened a new log
I20260810 06:44:23.390046 21825 raft_consensus.cc:729] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13eaa3f3901c4cc1b0ff745026c3cdf4, State: Initialized, Role: FOLLOWER
I20260810 06:44:23.390103 21826 ts_tablet_manager.cc:1397] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 06:44:23.390198 21825 consensus_queue.cc:260] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41363 } } peers { permanent_uuid: "bcd443570efb48e4b92d95dae8683b0f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44605 } } peers { permanent_uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 36007 } }
I20260810 06:44:23.390241 21827 raft_consensus.cc:348] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41363 } } peers { permanent_uuid: "bcd443570efb48e4b92d95dae8683b0f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44605 } } peers { permanent_uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 36007 } }
I20260810 06:44:23.390379 21827 raft_consensus.cc:374] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:23.390415 21827 raft_consensus.cc:729] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d63c4d52d5d4dab8b37c5e72cd6697b, State: Initialized, Role: FOLLOWER
I20260810 06:44:23.390465 21825 ts_tablet_manager.cc:1428] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:44:23.390481 21433 heartbeater.cc:503] Master 127.27.41.190:38953 was elected leader, sending a full tablet report...
I20260810 06:44:23.390529 21827 consensus_queue.cc:260] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41363 } } peers { permanent_uuid: "bcd443570efb48e4b92d95dae8683b0f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44605 } } peers { permanent_uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 36007 } }
I20260810 06:44:23.390801 21827 ts_tablet_manager.cc:1428] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:44:23.390916 21804 heartbeater.cc:503] Master 127.27.41.190:38953 was elected leader, sending a full tablet report...
I20260810 06:44:23.392504 21826 raft_consensus.cc:348] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41363 } } peers { permanent_uuid: "bcd443570efb48e4b92d95dae8683b0f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44605 } } peers { permanent_uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 36007 } }
I20260810 06:44:23.392652 21826 raft_consensus.cc:374] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:23.392690 21826 raft_consensus.cc:729] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcd443570efb48e4b92d95dae8683b0f, State: Initialized, Role: FOLLOWER
I20260810 06:44:23.392794 21826 consensus_queue.cc:260] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41363 } } peers { permanent_uuid: "bcd443570efb48e4b92d95dae8683b0f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44605 } } peers { permanent_uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 36007 } }
I20260810 06:44:23.392997 21826 ts_tablet_manager.cc:1428] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:44:23.393079 21623 heartbeater.cc:503] Master 127.27.41.190:38953 was elected leader, sending a full tablet report...
I20260810 06:44:23.403071 21835 raft_consensus.cc:482] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:44:23.403177 21835 raft_consensus.cc:504] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41363 } } peers { permanent_uuid: "bcd443570efb48e4b92d95dae8683b0f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44605 } } peers { permanent_uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 36007 } }
I20260810 06:44:23.403434 21835 leader_election.cc:288] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13eaa3f3901c4cc1b0ff745026c3cdf4 (127.27.41.129:41363), 5d63c4d52d5d4dab8b37c5e72cd6697b (127.27.41.131:36007)
I20260810 06:44:23.406395 21625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.403606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:41363 (local address 127.27.41.130:44281)
0810 06:44:23.403659 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:23.403671 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:23.403711 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:23.403868 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:23.403870 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:23.403873 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:23.403948 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.403950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.404693 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.404694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.405602 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.405604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.406149 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.406150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.406225 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.406228 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:44:23.406293 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 06:44:23.406332 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 06:44:23.406394 21819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.403665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:44281 (local address 127.27.41.129:41363)
0810 06:44:23.403725 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:23.403727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:23.403738 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:44:23.403766 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:23.403767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:23.403778 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:23.403851 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:23.404007 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.404599 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.405687 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.406060 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.406150 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.406158 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:23.406298 (+ 140us) server_negotiation.cc:299] Negotiation successful
0810 06:44:23.406332 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 06:44:23.406575 21824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.403831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:43571 (local address 127.27.41.131:36007)
0810 06:44:23.403885 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:23.403887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:23.403940 (+ 53us) server_negotiation.cc:407] Connection header received
0810 06:44:23.404056 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:23.404057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:23.404069 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:23.404115 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:23.404344 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.404782 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.405857 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.406211 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.406292 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.406299 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:23.406451 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 06:44:23.406498 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 06:44:23.406649 21836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.403724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:36007 (local address 127.27.41.130:43571)
0810 06:44:23.403893 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:23.403902 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:23.403953 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:23.404206 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:23.404207 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:23.404209 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:23.404277 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.404278 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.404902 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.404903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.405746 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:23.405748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.406292 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.406293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:23.406378 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.406381 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:44:23.406447 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 06:44:23.406561 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":72,"threads_started":1}
I20260810 06:44:23.406704 21362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deecd9cc521b4438a13454988845402d" candidate_uuid: "bcd443570efb48e4b92d95dae8683b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4" is_pre_election: true
I20260810 06:44:23.406840 21362 raft_consensus.cc:2454] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcd443570efb48e4b92d95dae8683b0f in term 0.
I20260810 06:44:23.406927 21742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deecd9cc521b4438a13454988845402d" candidate_uuid: "bcd443570efb48e4b92d95dae8683b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b" is_pre_election: true
I20260810 06:44:23.407074 21742 raft_consensus.cc:2454] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcd443570efb48e4b92d95dae8683b0f in term 0.
I20260810 06:44:23.407095 21459 leader_election.cc:302] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13eaa3f3901c4cc1b0ff745026c3cdf4, bcd443570efb48e4b92d95dae8683b0f; no voters:
I20260810 06:44:23.407220 21835 raft_consensus.cc:2781] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:44:23.407294 21835 raft_consensus.cc:482] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:44:23.407327 21835 raft_consensus.cc:3037] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:23.407948 21835 raft_consensus.cc:504] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41363 } } peers { permanent_uuid: "bcd443570efb48e4b92d95dae8683b0f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44605 } } peers { permanent_uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 36007 } }
I20260810 06:44:23.408078 21835 leader_election.cc:288] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [CANDIDATE]: Term 1 election: Requested vote from peers 13eaa3f3901c4cc1b0ff745026c3cdf4 (127.27.41.129:41363), 5d63c4d52d5d4dab8b37c5e72cd6697b (127.27.41.131:36007)
I20260810 06:44:23.408213 21362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deecd9cc521b4438a13454988845402d" candidate_uuid: "bcd443570efb48e4b92d95dae8683b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4"
I20260810 06:44:23.408228 21742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deecd9cc521b4438a13454988845402d" candidate_uuid: "bcd443570efb48e4b92d95dae8683b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b"
I20260810 06:44:23.408296 21742 raft_consensus.cc:3037] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:23.408300 21362 raft_consensus.cc:3037] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:23.408977 21742 raft_consensus.cc:2454] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcd443570efb48e4b92d95dae8683b0f in term 1.
I20260810 06:44:23.409075 21362 raft_consensus.cc:2454] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcd443570efb48e4b92d95dae8683b0f in term 1.
I20260810 06:44:23.409144 21459 leader_election.cc:302] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d63c4d52d5d4dab8b37c5e72cd6697b, bcd443570efb48e4b92d95dae8683b0f; no voters:
I20260810 06:44:23.409243 21835 raft_consensus.cc:2781] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:23.409420 21835 raft_consensus.cc:686] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [term 1 LEADER]: Becoming Leader. State: Replica: bcd443570efb48e4b92d95dae8683b0f, State: Running, Role: LEADER
I20260810 06:44:23.409519 21835 consensus_queue.cc:237] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41363 } } peers { permanent_uuid: "bcd443570efb48e4b92d95dae8683b0f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44605 } } peers { permanent_uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 36007 } }
I20260810 06:44:23.410269 21154 catalog_manager.cc:5495] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f reported cstate change: term changed from 0 to 1, leader changed from <none> to bcd443570efb48e4b92d95dae8683b0f (127.27.41.130). New cstate: current_term: 1 leader_uuid: "bcd443570efb48e4b92d95dae8683b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcd443570efb48e4b92d95dae8683b0f" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 36007 } health_report { overall_health: UNKNOWN } } }
I20260810 06:44:23.416091 21820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.413718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43022 (local address 127.27.41.130:44605)
0810 06:44:23.413775 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:23.413777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:23.413787 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:44:23.413875 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:23.413876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:23.413892 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:23.413960 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:23.414112 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.414538 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.415305 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:23.415508 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:23.415586 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:23.415744 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:23.415838 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:23.415945 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:23.415978 (+ 33us) server_negotiation.cc:299] Negotiation successful
0810 06:44:23.415985 (+ 7us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 06:44:23.417724 21362 raft_consensus.cc:1261] T deecd9cc521b4438a13454988845402d P 13eaa3f3901c4cc1b0ff745026c3cdf4 [term 1 FOLLOWER]: Refusing update from remote peer bcd443570efb48e4b92d95dae8683b0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:23.417750 21742 raft_consensus.cc:1261] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b [term 1 FOLLOWER]: Refusing update from remote peer bcd443570efb48e4b92d95dae8683b0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:23.418079 21837 consensus_queue.cc:1035] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "13eaa3f3901c4cc1b0ff745026c3cdf4" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:23.418200 21835 consensus_queue.cc:1035] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d63c4d52d5d4dab8b37c5e72cd6697b" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 36007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:23.420485 21842 mvcc.cc:205] Tried to move back new op lower bound from 7316866102956515328 to 7316866102926069760. Current Snapshot: MvccSnapshot[applied={T|T < 7316866102956515328}]
I20260810 06:44:23.421042 21843 mvcc.cc:205] Tried to move back new op lower bound from 7316866102956515328 to 7316866102926069760. Current Snapshot: MvccSnapshot[applied={T|T < 7316866102956515328 or (T in {7316866102956515328})}]
I20260810 06:44:23.421355 21844 mvcc.cc:205] Tried to move back new op lower bound from 7316866102956515328 to 7316866102926069760. Current Snapshot: MvccSnapshot[applied={T|T < 7316866102956515328}]
I20260810 06:44:23.422827 21154 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:44:23.422919 21154 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:44:23.423635 21154 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fab5a97209334427bfc71c5b0d639571: Sending DeleteTablet for 3 replicas of tablet deecd9cc521b4438a13454988845402d
I20260810 06:44:23.424010 21717 tablet_service.cc:1514] Processing DeleteTablet for tablet deecd9cc521b4438a13454988845402d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:23 UTC) from {username='slave'} at 127.0.0.1:42612
I20260810 06:44:23.423981 21528 tablet_service.cc:1514] Processing DeleteTablet for tablet deecd9cc521b4438a13454988845402d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:23 UTC) from {username='slave'} at 127.0.0.1:43008
I20260810 06:44:23.423995 21338 tablet_service.cc:1514] Processing DeleteTablet for tablet deecd9cc521b4438a13454988845402d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:23 UTC) from {username='slave'} at 127.0.0.1:59044
I20260810 06:44:23.424211 21856 tablet_replica.cc:330] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f: stopping tablet replica
I20260810 06:44:23.424337 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 21248
I20260810 06:44:23.433553 21856 raft_consensus.cc:2229] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:44:23.433729 21856 raft_consensus.cc:2258] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:44:23.435400 21857 tablet_replica.cc:330] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b: stopping tablet replica
I20260810 06:44:23.435546 21857 raft_consensus.cc:2229] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:44:23.435668 21857 raft_consensus.cc:2258] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:44:23.436053 21856 ts_tablet_manager.cc:1905] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:44:23.436203 21857 ts_tablet_manager.cc:1905] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:44:23.437646 21856 ts_tablet_manager.cc:1918] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:44:23.437791 21856 log.cc:1196] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/deecd9cc521b4438a13454988845402d
I20260810 06:44:23.437839 21857 ts_tablet_manager.cc:1918] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:44:23.438000 21857 log.cc:1196] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/deecd9cc521b4438a13454988845402d
I20260810 06:44:23.438253 21856 ts_tablet_manager.cc:1939] T deecd9cc521b4438a13454988845402d P bcd443570efb48e4b92d95dae8683b0f: Deleting consensus metadata
I20260810 06:44:23.438438 21857 ts_tablet_manager.cc:1939] T deecd9cc521b4438a13454988845402d P 5d63c4d52d5d4dab8b37c5e72cd6697b: Deleting consensus metadata
I20260810 06:44:23.438771 21138 catalog_manager.cc:4841] TS bcd443570efb48e4b92d95dae8683b0f (127.27.41.130:44605): tablet deecd9cc521b4438a13454988845402d (table test-table [id=e73f1ebbeba84929a40f093dc81de296]) successfully deleted
I20260810 06:44:23.438910 21134 catalog_manager.cc:4841] TS 5d63c4d52d5d4dab8b37c5e72cd6697b (127.27.41.131:36007): tablet deecd9cc521b4438a13454988845402d (table test-table [id=e73f1ebbeba84929a40f093dc81de296]) successfully deleted
W20260810 06:44:23.442296 21134 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:41363 (error 108)
I20260810 06:44:23.442621 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 21436
I20260810 06:44:23.442791 21815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:23.442640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:41363 (local address 127.0.0.1:59052)
0810 06:44:23.442706 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:23.442753 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:41363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 06:44:23.444290 21134 catalog_manager.cc:4584] TS 13eaa3f3901c4cc1b0ff745026c3cdf4 (127.27.41.129:41363): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet deecd9cc521b4438a13454988845402d: Network error: Client connection negotiation failed: client connection to 127.27.41.129:41363: connect: Connection refused (error 111)
I20260810 06:44:23.449532 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 21626
I20260810 06:44:23.470686 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 21107
2026-08-10T06:44:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (695 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:23 dist-test-slave-bw88 krb5kdc[21862](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:23 dist-test-slave-bw88 krb5kdc[21862](info): set up 2 sockets
Aug 10 06:44:23 dist-test-slave-bw88 krb5kdc[21862](info): commencing operation
krb5kdc: starting...
W20260810 06:44:24.671031 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:24 dist-test-slave-bw88 krb5kdc[21862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:44:24.791731 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:33619
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:46763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:33619
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:24.874050 21880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:24.874262 21880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:24.874286 21880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:24.875439 21880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:24.875481 21880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:24.875494 21880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:24.875506 21880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:24.875519 21880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:24.877110 21880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:46763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:33619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:33619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:24.877404 21880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:24.877671 21880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:24.882728 21888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:24.882730 21886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:24.882951 21880 server_base.cc:1034] running on GCE node
W20260810 06:44:24.882752 21885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:24.883347 21880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:24.883680 21880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:24.884829 21880 hybrid_clock.cc:648] HybridClock initialized: now 1786344264884821 us; error 40 us; skew 500 ppm
Aug 10 06:44:24 dist-test-slave-bw88 krb5kdc[21862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344264, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:24.887284 21880 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:44:24.887712 21880 webserver.cc:460] Webserver started at http://127.27.41.190:42057/ using document root <none> and password file <none>
I20260810 06:44:24.887955 21880 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:24.888024 21880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:24.888183 21880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:24.889212 21880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "bda31615fcb2435590afaf58e8af4cb0"
format_stamp: "Formatted at 2026-08-10 06:44:24 on dist-test-slave-bw88"
server_key: "d33ef07bac8b830ca9e63a6bdaef208e"
server_key_iv: "28389adfb67f5537513e5a48666e1545"
server_key_version: "encryptionkey@0"
I20260810 06:44:24.889628 21880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "bda31615fcb2435590afaf58e8af4cb0"
format_stamp: "Formatted at 2026-08-10 06:44:24 on dist-test-slave-bw88"
server_key: "d33ef07bac8b830ca9e63a6bdaef208e"
server_key_iv: "28389adfb67f5537513e5a48666e1545"
server_key_version: "encryptionkey@0"
I20260810 06:44:24.890924 21880 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:44:24.891619 21900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:24.891793 21880 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:24.891903 21880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "bda31615fcb2435590afaf58e8af4cb0"
format_stamp: "Formatted at 2026-08-10 06:44:24 on dist-test-slave-bw88"
server_key: "d33ef07bac8b830ca9e63a6bdaef208e"
server_key_iv: "28389adfb67f5537513e5a48666e1545"
server_key_version: "encryptionkey@0"
I20260810 06:44:24.891994 21880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:24.915349 21880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:24.917229 21880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:24.917433 21880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:24.921223 21880 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:33619
I20260810 06:44:24.921270 21977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:33619 every 8 connection(s)
I20260810 06:44:24.921674 21880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:24.922556 21978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:24.924793 21978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0: Bootstrap starting.
I20260810 06:44:24.925336 21978 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:24.925678 21978 log.cc:824] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:24.926375 21978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0: No bootstrap required, opened a new log
I20260810 06:44:24.926707 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 21880
I20260810 06:44:24.926839 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:24.927054 27814 external_mini_cluster.cc:1428] Setting key f914da5186a1a92683cc1041f0c50aa4
I20260810 06:44:24.928576 21978 raft_consensus.cc:348] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda31615fcb2435590afaf58e8af4cb0" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33619 } }
I20260810 06:44:24.928757 21978 raft_consensus.cc:374] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:24.928800 21978 raft_consensus.cc:729] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda31615fcb2435590afaf58e8af4cb0, State: Initialized, Role: FOLLOWER
I20260810 06:44:24.928942 21978 consensus_queue.cc:260] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda31615fcb2435590afaf58e8af4cb0" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33619 } }
I20260810 06:44:24.929033 21978 raft_consensus.cc:388] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:24.929070 21978 raft_consensus.cc:482] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:24.929126 21978 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:24.930195 21978 raft_consensus.cc:504] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda31615fcb2435590afaf58e8af4cb0" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33619 } }
I20260810 06:44:24.930291 21978 leader_election.cc:302] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bda31615fcb2435590afaf58e8af4cb0; no voters:
I20260810 06:44:24.930488 21978 leader_election.cc:288] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:24.930532 21984 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:24.930721 21984 raft_consensus.cc:686] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [term 1 LEADER]: Becoming Leader. State: Replica: bda31615fcb2435590afaf58e8af4cb0, State: Running, Role: LEADER
I20260810 06:44:24.930783 21978 sys_catalog.cc:564] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:24.930900 21984 consensus_queue.cc:237] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda31615fcb2435590afaf58e8af4cb0" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33619 } }
I20260810 06:44:24.932126 21985 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bda31615fcb2435590afaf58e8af4cb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda31615fcb2435590afaf58e8af4cb0" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33619 } } }
I20260810 06:44:24.932209 21985 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:24.932168 21987 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bda31615fcb2435590afaf58e8af4cb0. Latest consensus state: current_term: 1 leader_uuid: "bda31615fcb2435590afaf58e8af4cb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda31615fcb2435590afaf58e8af4cb0" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33619 } } }
I20260810 06:44:24.932271 21987 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0 [sys.catalog]: This master's current role is: LEADER
W20260810 06:44:24.932827 22006 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:44:24.932896 22006 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:44:24.932983 22005 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:24.933171 22005 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:24.934806 22005 catalog_manager.cc:1347] Generated new cluster ID: 84ce4b3d1d4844b0aa0373776bfa394c
I20260810 06:44:24.934859 22005 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:44:24 dist-test-slave-bw88 krb5kdc[21862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:24.939777 21983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:24.927596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34332 (local address 127.27.41.190:33619)
0810 06:44:24.927789 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:24.927798 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:24.927823 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:44:24.928561 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:24.928567 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:24.928612 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:24.928722 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:24.929652 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:24.930752 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:24.931894 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:24.932580 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:24.932684 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:24.935696 (+ 3012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:24.935700 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:24.935701 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:24.935713 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:24.937785 (+ 2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:24.938202 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:24.938219 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:24.938220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:24.938353 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:24.938564 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:24.938565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:24.938565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:24.938865 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:24.939030 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:24.939100 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 06:44:24.939369 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
I20260810 06:44:24.943908 22005 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:24.944412 22005 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:24.950171 22005 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0: Generated new TSK 0
I20260810 06:44:24.950348 22005 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.41.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
Entry for principal kudu/127.27.41.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab.
I20260810 06:44:24.978025 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33619
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:46763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:25.062459 22016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:25.062680 22016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:25.062741 22016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:25.063917 22016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:25.063961 22016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:25.063985 22016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:44:25.065336 22016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:46763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.129.keytab
--principal=kudu/127.27.41.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:25.065547 22016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:25.065726 22016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:25.070683 22025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:25.070696 22026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:25.070694 22029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:25.070950 22016 server_base.cc:1034] running on GCE node
I20260810 06:44:25.071166 22016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:25.071399 22016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:25.072567 22016 hybrid_clock.cc:648] HybridClock initialized: now 1786344265072561 us; error 37 us; skew 500 ppm
Aug 10 06:44:25 dist-test-slave-bw88 krb5kdc[21862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344265, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:25.075132 22016 init.cc:377] Logged in from keytab as kudu/127.27.41.129@KRBTEST.COM (short username kudu)
I20260810 06:44:25.075548 22016 webserver.cc:460] Webserver started at http://127.27.41.129:36227/ using document root <none> and password file <none>
I20260810 06:44:25.075765 22016 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:25.075832 22016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:25.075978 22016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:25.077000 22016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "f0c9325389f84e1d8e8a1a3ced7cd321"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "64634c7a8a149f626b4a2d257b34a619"
server_key_iv: "b1e97250af0f85644dbae2356485fa26"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.077433 22016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "f0c9325389f84e1d8e8a1a3ced7cd321"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "64634c7a8a149f626b4a2d257b34a619"
server_key_iv: "b1e97250af0f85644dbae2356485fa26"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.078727 22016 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:44:25.079494 22036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.079670 22016 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:25.079771 22016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "f0c9325389f84e1d8e8a1a3ced7cd321"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "64634c7a8a149f626b4a2d257b34a619"
server_key_iv: "b1e97250af0f85644dbae2356485fa26"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.079854 22016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:25.108377 22016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:25.110332 22016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:25.110497 22016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:25.110953 22016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:25.111307 22016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:25.111366 22016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.111406 22016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:25.111431 22016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.117522 22016 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:42849
I20260810 06:44:25.117578 22197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:42849 every 8 connection(s)
I20260810 06:44:25.117904 22016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:44:25.123644 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 22016
Aug 10 06:44:25 dist-test-slave-bw88 krb5kdc[21862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344265, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.129@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:25.123749 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:44:25.123982 27814 external_mini_cluster.cc:1428] Setting key 4e496650a03eb5484160070f511e8c33
I20260810 06:44:25.127483 21983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.118646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:57615 (local address 127.27.41.190:33619)
0810 06:44:25.118727 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:25.118729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:25.118903 (+ 174us) server_negotiation.cc:407] Connection header received
0810 06:44:25.119408 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:25.119409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:25.119419 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:25.119469 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:25.120384 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.120877 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.121928 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.122131 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.122192 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.124317 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:25.124318 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:25.124318 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:25.124326 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:25.126078 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:25.126462 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:25.126463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:25.126464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:25.126532 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:25.126874 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:25.126875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:25.126875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:25.126978 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:25.127031 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:25.127344 (+ 313us) server_negotiation.cc:299] Negotiation successful
0810 06:44:25.127420 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 06:44:25.127735 22201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.118584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:33619 (local address 127.27.41.129:57615)
0810 06:44:25.118770 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:25.118806 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:25.119327 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:25.119530 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:25.119533 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:25.120108 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:25.120294 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.120299 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.120968 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.120969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.121846 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.121849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.122207 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.122208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.122310 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.122724 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:25.122732 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:25.124188 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:25.126162 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:25.126169 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:25.126171 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:25.126389 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:25.126625 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:25.126639 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:25.126639 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:25.126792 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:25.127045 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:25.127052 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:25.127208 (+ 156us) client_negotiation.cc:769] Sending connection context
0810 06:44:25.127323 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 06:44:25.127492 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":97,"threads_started":1}
I20260810 06:44:25.128293 22198 heartbeater.cc:347] Connected to a master server at 127.27.41.190:33619
I20260810 06:44:25.128372 22198 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:25.128561 22198 heartbeater.cc:511] Master 127.27.41.190:33619 requested a full tablet report, sending...
I20260810 06:44:25.129187 21927 ts_manager.cc:194] Registered new tserver with Master: f0c9325389f84e1d8e8a1a3ced7cd321 (127.27.41.129:42849)
I20260810 06:44:25.130203 21927 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.129@KRBTEST.COM'} at 127.27.41.129:57615
WARNING: no policy specified for kudu/127.27.41.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
Entry for principal kudu/127.27.41.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab.
I20260810 06:44:25.152390 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33619
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:46763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:25.234545 22204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:25.234745 22204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:25.234769 22204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:25.235900 22204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:25.235940 22204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:25.235991 22204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:44:25.237521 22204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:46763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.130.keytab
--principal=kudu/127.27.41.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:25.237756 22204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:25.237984 22204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:25.243104 22210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:25.243073 22211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:25.243281 22204 server_base.cc:1034] running on GCE node
W20260810 06:44:25.243100 22214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:25.243610 22204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:25.243887 22204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:25.245083 22204 hybrid_clock.cc:648] HybridClock initialized: now 1786344265245056 us; error 45 us; skew 500 ppm
Aug 10 06:44:25 dist-test-slave-bw88 krb5kdc[21862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344265, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:25.247751 22204 init.cc:377] Logged in from keytab as kudu/127.27.41.130@KRBTEST.COM (short username kudu)
I20260810 06:44:25.248131 22204 webserver.cc:460] Webserver started at http://127.27.41.130:35929/ using document root <none> and password file <none>
I20260810 06:44:25.248324 22204 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:25.248377 22204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:25.248466 22204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:25.249464 22204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "c8656096a76c490596677fe66e454fe0"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "b001c929f519b3d232ece1bbf8ba647a"
server_key_iv: "992fe48b23e4aa277da2dcb458d67228"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.249787 22204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "c8656096a76c490596677fe66e454fe0"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "b001c929f519b3d232ece1bbf8ba647a"
server_key_iv: "992fe48b23e4aa277da2dcb458d67228"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.250998 22204 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:44:25.251668 22223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.251864 22204 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.251945 22204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "c8656096a76c490596677fe66e454fe0"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "b001c929f519b3d232ece1bbf8ba647a"
server_key_iv: "992fe48b23e4aa277da2dcb458d67228"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.251997 22204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:25.264460 22204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:25.266351 22204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:25.266460 22204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:25.266649 22204 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:25.266886 22204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:25.266959 22204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.266993 22204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:25.267014 22204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.272874 22204 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:37027
I20260810 06:44:25.272959 22380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:37027 every 8 connection(s)
I20260810 06:44:25.273253 22204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:44:25.277185 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 22204
I20260810 06:44:25.277328 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:44:25.277542 27814 external_mini_cluster.cc:1428] Setting key 9a2be303df3399f818c6cb91d2904e50
Aug 10 06:44:25 dist-test-slave-bw88 krb5kdc[21862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344265, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.130@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:25.283392 21983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.274089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:33765 (local address 127.27.41.190:33619)
0810 06:44:25.274184 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:25.274186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:25.274356 (+ 170us) server_negotiation.cc:407] Connection header received
0810 06:44:25.274879 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:25.274881 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:25.274896 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:25.274955 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:25.275892 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.276410 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.277582 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.277851 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.277938 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.280378 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:25.280379 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:25.280379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:25.280386 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:25.281826 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:25.282352 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:25.282353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:25.282354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:25.282408 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:25.282749 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:25.282750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:25.282751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:25.282857 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:25.282912 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:25.283265 (+ 353us) server_negotiation.cc:299] Negotiation successful
0810 06:44:25.283330 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 06:44:25.283738 22386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.274038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:33619 (local address 127.27.41.130:33765)
0810 06:44:25.274237 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:25.274271 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:25.274765 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:25.275016 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:25.275025 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:25.275593 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:25.275777 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.275781 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.276518 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.276519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.277485 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.277488 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.278036 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.278038 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.278209 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.278735 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:25.278745 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:25.280249 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:25.281909 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:25.281917 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:25.281920 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:25.282262 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:25.282522 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:25.282523 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:25.282524 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:25.282673 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:25.282930 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:25.282938 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:25.283115 (+ 177us) client_negotiation.cc:769] Sending connection context
0810 06:44:25.283242 (+ 127us) client_negotiation.cc:240] Negotiation successful
0810 06:44:25.283421 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":98,"threads_started":1}
I20260810 06:44:25.284260 22383 heartbeater.cc:347] Connected to a master server at 127.27.41.190:33619
I20260810 06:44:25.284368 22383 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:25.284567 22383 heartbeater.cc:511] Master 127.27.41.190:33619 requested a full tablet report, sending...
I20260810 06:44:25.284965 21927 ts_manager.cc:194] Registered new tserver with Master: c8656096a76c490596677fe66e454fe0 (127.27.41.130:37027)
I20260810 06:44:25.285457 21927 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.130@KRBTEST.COM'} at 127.27.41.130:33765
WARNING: no policy specified for kudu/127.27.41.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
Entry for principal kudu/127.27.41.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab.
I20260810 06:44:25.303869 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33619
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:46763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:25.386468 22390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:25.386699 22390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:25.386740 22390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:25.387843 22390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:25.387907 22390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:25.387952 22390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:44:25.389407 22390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:46763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.131.keytab
--principal=kudu/127.27.41.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:33619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:25.389665 22390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:25.389943 22390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:25.394883 22398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:25.394936 22397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:25.395043 22402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:25.395360 22390 server_base.cc:1034] running on GCE node
I20260810 06:44:25.395591 22390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:25.395859 22390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:25.397011 22390 hybrid_clock.cc:648] HybridClock initialized: now 1786344265397010 us; error 37 us; skew 500 ppm
Aug 10 06:44:25 dist-test-slave-bw88 krb5kdc[21862](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344265, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:25.399596 22390 init.cc:377] Logged in from keytab as kudu/127.27.41.131@KRBTEST.COM (short username kudu)
I20260810 06:44:25.400017 22390 webserver.cc:460] Webserver started at http://127.27.41.131:39303/ using document root <none> and password file <none>
I20260810 06:44:25.400238 22390 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:25.400283 22390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:25.400444 22390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:25.401551 22390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "82faf8985acf45afa26fb79cb10b8621"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "ec2cfcceea7ae8519af7a4abfc66ee2f"
server_key_iv: "cef4b965f58ec8823aeb2216e900106e"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.401934 22390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "82faf8985acf45afa26fb79cb10b8621"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "ec2cfcceea7ae8519af7a4abfc66ee2f"
server_key_iv: "cef4b965f58ec8823aeb2216e900106e"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.403241 22390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:44:25.403927 22414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.404105 22390 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:25.404214 22390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "82faf8985acf45afa26fb79cb10b8621"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "ec2cfcceea7ae8519af7a4abfc66ee2f"
server_key_iv: "cef4b965f58ec8823aeb2216e900106e"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.404289 22390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:25.420300 22390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:25.422616 22390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:25.422782 22390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:25.423018 22390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:25.423347 22390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:25.423403 22390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.423444 22390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:25.423485 22390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.429656 22390 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:46239
I20260810 06:44:25.429703 22581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:46239 every 8 connection(s)
I20260810 06:44:25.430014 22390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
Aug 10 06:44:25 dist-test-slave-bw88 krb5kdc[21862](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344265, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.131@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:25.438786 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 22390
I20260810 06:44:25.438931 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:44:25.439136 27814 external_mini_cluster.cc:1428] Setting key c606d6e4c050c27bb0dd8e81d64cc405
I20260810 06:44:25.439790 21983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.430888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:51663 (local address 127.27.41.190:33619)
0810 06:44:25.431437 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:25.431439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:25.431454 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:44:25.431913 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:25.431914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:25.431924 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:25.431972 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:25.433055 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.433628 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.434586 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.434773 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.434821 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.436782 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:25.436783 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:25.436783 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:25.436790 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:25.438283 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:25.438659 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:25.438660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:25.438661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:25.438725 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:25.439008 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:25.439009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:25.439009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:25.439158 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:25.439228 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:25.439612 (+ 384us) server_negotiation.cc:299] Negotiation successful
0810 06:44:25.439695 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518}
I20260810 06:44:25.440173 22584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.430878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:33619 (local address 127.27.41.131:51663)
0810 06:44:25.431135 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:25.431183 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:25.431802 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:25.432086 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:25.432090 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:25.432775 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:25.432966 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.432972 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.433708 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.433709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.434505 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.434507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.434843 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.434843 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.434941 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.435359 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:25.435366 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:25.436692 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:25.438352 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:25.438357 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:25.438359 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:25.438589 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:25.438796 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:25.438796 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:25.438797 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:25.438932 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:25.439229 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:25.439235 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:25.439407 (+ 172us) client_negotiation.cc:769] Sending connection context
0810 06:44:25.439765 (+ 358us) client_negotiation.cc:240] Negotiation successful
0810 06:44:25.439931 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":154,"threads_started":1}
I20260810 06:44:25.440567 22582 heartbeater.cc:347] Connected to a master server at 127.27.41.190:33619
I20260810 06:44:25.440665 22582 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:25.440843 22582 heartbeater.cc:511] Master 127.27.41.190:33619 requested a full tablet report, sending...
I20260810 06:44:25.441222 21927 ts_manager.cc:194] Registered new tserver with Master: 82faf8985acf45afa26fb79cb10b8621 (127.27.41.131:46239)
I20260810 06:44:25.441618 21927 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.41.131@KRBTEST.COM'} at 127.27.41.131:51663
I20260810 06:44:25.450932 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:44:25.457736 21983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.452195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34336 (local address 127.27.41.190:33619)
0810 06:44:25.452241 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:25.452243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:25.452367 (+ 124us) server_negotiation.cc:407] Connection header received
0810 06:44:25.452405 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:25.452406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:25.452414 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:25.452462 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:25.452968 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.453471 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.454190 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.454357 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.454406 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.455695 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:25.455696 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:25.455697 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:25.455702 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:25.456781 (+ 1079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:25.457077 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:25.457077 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:25.457078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:25.457124 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:25.457284 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:25.457285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:25.457285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:25.457449 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:25.457526 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:25.457628 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 06:44:25.457683 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 06:44:25.459143 21927 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:44:25.460677 21927 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:44:25.467186 22604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.463021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:37027 (local address 127.0.0.1:40170)
0810 06:44:25.463410 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:25.463423 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:25.463489 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:25.463906 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:25.463908 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:25.463910 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:25.463951 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.463952 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.465212 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.465213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.466149 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.466151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.466853 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.466854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.466936 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.466949 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 06:44:25.467048 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 06:44:25.467103 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":81,"threads_started":1}
I20260810 06:44:25.467204 22602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.463156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40170 (local address 127.27.41.130:37027)
0810 06:44:25.463354 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:25.463358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:25.463552 (+ 194us) server_negotiation.cc:407] Connection header received
0810 06:44:25.463600 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:25.463602 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:25.463618 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:25.463805 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:25.464029 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.465111 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.466250 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.466747 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.466847 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.466909 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:25.467075 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 06:44:25.467115 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":101,"threads_started":1}
I20260810 06:44:25.467362 22600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.463204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:42849 (local address 127.0.0.1:35412)
0810 06:44:25.463445 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:25.463455 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:25.463499 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:25.463868 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:25.463869 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:25.463871 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:25.463922 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.463923 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.464839 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.464840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.466181 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.466184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.467122 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.467123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.467199 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.467203 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:44:25.467250 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 06:44:25.467292 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":20,"thread_start_us":59,"threads_started":1}
I20260810 06:44:25.467772 22606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.463471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35412 (local address 127.27.41.129:42849)
0810 06:44:25.463673 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:25.463677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:25.463687 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:44:25.463724 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:25.463726 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:25.463741 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:25.463822 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:25.463996 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.464737 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.466284 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.467014 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.467546 (+ 532us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.467618 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:25.467646 (+ 28us) server_negotiation.cc:299] Negotiation successful
0810 06:44:25.467693 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":107,"threads_started":1}
I20260810 06:44:25.467957 22599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.463013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:46239 (local address 127.0.0.1:48090)
0810 06:44:25.463323 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:25.463365 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:25.463441 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:25.463699 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:25.463702 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:25.463705 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:25.463773 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.463775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.465102 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.465103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.466204 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.466205 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.467191 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.467192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.467277 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.467281 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:44:25.467842 (+ 561us) client_negotiation.cc:240] Negotiation successful
0810 06:44:25.467892 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":3,"thread_start_us":52,"threads_started":1}
I20260810 06:44:25.468012 22601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.463100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48090 (local address 127.27.41.131:46239)
0810 06:44:25.463298 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:25.463304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:25.463546 (+ 242us) server_negotiation.cc:407] Connection header received
0810 06:44:25.463592 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:25.463595 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:25.463610 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:25.463693 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:25.463868 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.464988 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.466292 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.467017 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.467091 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.467150 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:25.467887 (+ 737us) server_negotiation.cc:299] Negotiation successful
0810 06:44:25.467935 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
I20260810 06:44:25.468328 22283 tablet_service.cc:1467] Processing CreateTablet for tablet cdadace8b095451abc1d51fa455ade04 (DEFAULT_TABLE table=test-table [id=245b72000c4d4137840ed434808d2ed5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:25.468436 22100 tablet_service.cc:1467] Processing CreateTablet for tablet cdadace8b095451abc1d51fa455ade04 (DEFAULT_TABLE table=test-table [id=245b72000c4d4137840ed434808d2ed5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:25.468637 22283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdadace8b095451abc1d51fa455ade04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:25.468631 22496 tablet_service.cc:1467] Processing CreateTablet for tablet cdadace8b095451abc1d51fa455ade04 (DEFAULT_TABLE table=test-table [id=245b72000c4d4137840ed434808d2ed5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:25.468787 22100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdadace8b095451abc1d51fa455ade04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:25.468909 22496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdadace8b095451abc1d51fa455ade04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:25.471381 22608 tablet_bootstrap.cc:492] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0: Bootstrap starting.
I20260810 06:44:25.472049 22608 tablet_bootstrap.cc:654] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:25.472018 22612 tablet_bootstrap.cc:492] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621: Bootstrap starting.
I20260810 06:44:25.472255 22610 tablet_bootstrap.cc:492] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321: Bootstrap starting.
I20260810 06:44:25.472754 22608 log.cc:824] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:25.473079 22612 tablet_bootstrap.cc:654] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:25.473699 22608 tablet_bootstrap.cc:492] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0: No bootstrap required, opened a new log
I20260810 06:44:25.473727 22612 log.cc:824] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:25.473778 22608 ts_tablet_manager.cc:1397] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:44:25.473965 22610 tablet_bootstrap.cc:654] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:25.474473 22610 log.cc:824] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:25.474606 22612 tablet_bootstrap.cc:492] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621: No bootstrap required, opened a new log
I20260810 06:44:25.474709 22612 ts_tablet_manager.cc:1397] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:44:25.475806 22608 raft_consensus.cc:348] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82faf8985acf45afa26fb79cb10b8621" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46239 } } peers { permanent_uuid: "c8656096a76c490596677fe66e454fe0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37027 } } peers { permanent_uuid: "f0c9325389f84e1d8e8a1a3ced7cd321" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 42849 } }
I20260810 06:44:25.476027 22608 raft_consensus.cc:374] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:25.476080 22608 raft_consensus.cc:729] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8656096a76c490596677fe66e454fe0, State: Initialized, Role: FOLLOWER
I20260810 06:44:25.476198 22608 consensus_queue.cc:260] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82faf8985acf45afa26fb79cb10b8621" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46239 } } peers { permanent_uuid: "c8656096a76c490596677fe66e454fe0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37027 } } peers { permanent_uuid: "f0c9325389f84e1d8e8a1a3ced7cd321" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 42849 } }
I20260810 06:44:25.476486 22608 ts_tablet_manager.cc:1428] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 06:44:25.476511 22383 heartbeater.cc:503] Master 127.27.41.190:33619 was elected leader, sending a full tablet report...
I20260810 06:44:25.476686 22612 raft_consensus.cc:348] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82faf8985acf45afa26fb79cb10b8621" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46239 } } peers { permanent_uuid: "c8656096a76c490596677fe66e454fe0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37027 } } peers { permanent_uuid: "f0c9325389f84e1d8e8a1a3ced7cd321" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 42849 } }
I20260810 06:44:25.476864 22612 raft_consensus.cc:374] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:25.476914 22612 raft_consensus.cc:729] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82faf8985acf45afa26fb79cb10b8621, State: Initialized, Role: FOLLOWER
I20260810 06:44:25.477025 22612 consensus_queue.cc:260] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82faf8985acf45afa26fb79cb10b8621" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46239 } } peers { permanent_uuid: "c8656096a76c490596677fe66e454fe0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37027 } } peers { permanent_uuid: "f0c9325389f84e1d8e8a1a3ced7cd321" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 42849 } }
I20260810 06:44:25.477246 22610 tablet_bootstrap.cc:492] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321: No bootstrap required, opened a new log
I20260810 06:44:25.477308 22610 ts_tablet_manager.cc:1397] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 06:44:25.477304 22612 ts_tablet_manager.cc:1428] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:44:25.477440 22582 heartbeater.cc:503] Master 127.27.41.190:33619 was elected leader, sending a full tablet report...
I20260810 06:44:25.478825 22610 raft_consensus.cc:348] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82faf8985acf45afa26fb79cb10b8621" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46239 } } peers { permanent_uuid: "c8656096a76c490596677fe66e454fe0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37027 } } peers { permanent_uuid: "f0c9325389f84e1d8e8a1a3ced7cd321" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 42849 } }
I20260810 06:44:25.478960 22610 raft_consensus.cc:374] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:25.478979 22610 raft_consensus.cc:729] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0c9325389f84e1d8e8a1a3ced7cd321, State: Initialized, Role: FOLLOWER
I20260810 06:44:25.479117 22610 consensus_queue.cc:260] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82faf8985acf45afa26fb79cb10b8621" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46239 } } peers { permanent_uuid: "c8656096a76c490596677fe66e454fe0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37027 } } peers { permanent_uuid: "f0c9325389f84e1d8e8a1a3ced7cd321" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 42849 } }
I20260810 06:44:25.479336 22610 ts_tablet_manager.cc:1428] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:44:25.479456 22198 heartbeater.cc:503] Master 127.27.41.190:33619 was elected leader, sending a full tablet report...
W20260810 06:44:25.523881 22385 tablet.cc:2369] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:44:25.565786 22618 raft_consensus.cc:482] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:44:25.565922 22618 raft_consensus.cc:504] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82faf8985acf45afa26fb79cb10b8621" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46239 } } peers { permanent_uuid: "c8656096a76c490596677fe66e454fe0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37027 } } peers { permanent_uuid: "f0c9325389f84e1d8e8a1a3ced7cd321" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 42849 } }
I20260810 06:44:25.566329 22618 leader_election.cc:288] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82faf8985acf45afa26fb79cb10b8621 (127.27.41.131:46239), f0c9325389f84e1d8e8a1a3ced7cd321 (127.27.41.129:42849)
I20260810 06:44:25.569319 22386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.566579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:46239 (local address 127.27.41.130:53787)
0810 06:44:25.566647 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:25.566660 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:25.566743 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:25.566915 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:25.566916 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:25.566918 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:25.567001 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.567003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.567672 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.567673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.568418 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.568420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.569028 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.569030 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.569116 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.569119 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:44:25.569190 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 06:44:25.569236 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 06:44:25.569319 22601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.566722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:53787 (local address 127.27.41.131:46239)
0810 06:44:25.566778 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:25.566781 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:25.566792 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:44:25.566827 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:25.566828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:25.566839 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:25.566901 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:25.567099 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.567584 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.568523 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.568926 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.569018 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.569027 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:25.569199 (+ 172us) server_negotiation.cc:299] Negotiation successful
0810 06:44:25.569242 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 06:44:25.569473 22622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.566718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:42849 (local address 127.27.41.130:51653)
0810 06:44:25.566928 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:25.566938 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:25.566995 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:25.567147 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:25.567148 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:25.567150 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:25.567233 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.567234 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.567872 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.567873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.568611 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.568613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.569178 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.569179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.569255 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.569258 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:44:25.569339 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 06:44:25.569394 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":134,"threads_started":1}
I20260810 06:44:25.569464 22606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.566875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:51653 (local address 127.27.41.129:42849)
0810 06:44:25.566922 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:25.566924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:25.567001 (+ 77us) server_negotiation.cc:407] Connection header received
0810 06:44:25.567052 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:25.567053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:25.567063 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:25.567135 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:25.567308 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.567784 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.568706 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.569093 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.569178 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.569187 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:25.569367 (+ 180us) server_negotiation.cc:299] Negotiation successful
0810 06:44:25.569406 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 06:44:25.569741 22519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadace8b095451abc1d51fa455ade04" candidate_uuid: "c8656096a76c490596677fe66e454fe0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82faf8985acf45afa26fb79cb10b8621" is_pre_election: true
I20260810 06:44:25.569818 22129 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadace8b095451abc1d51fa455ade04" candidate_uuid: "c8656096a76c490596677fe66e454fe0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0c9325389f84e1d8e8a1a3ced7cd321" is_pre_election: true
I20260810 06:44:25.569900 22519 raft_consensus.cc:2454] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8656096a76c490596677fe66e454fe0 in term 0.
I20260810 06:44:25.569998 22129 raft_consensus.cc:2454] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8656096a76c490596677fe66e454fe0 in term 0.
I20260810 06:44:25.570163 22226 leader_election.cc:302] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82faf8985acf45afa26fb79cb10b8621, c8656096a76c490596677fe66e454fe0; no voters:
I20260810 06:44:25.570325 22618 raft_consensus.cc:2781] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:44:25.570403 22618 raft_consensus.cc:482] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:44:25.570421 22618 raft_consensus.cc:3037] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:25.571183 22618 raft_consensus.cc:504] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82faf8985acf45afa26fb79cb10b8621" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46239 } } peers { permanent_uuid: "c8656096a76c490596677fe66e454fe0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37027 } } peers { permanent_uuid: "f0c9325389f84e1d8e8a1a3ced7cd321" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 42849 } }
I20260810 06:44:25.571322 22618 leader_election.cc:288] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [CANDIDATE]: Term 1 election: Requested vote from peers 82faf8985acf45afa26fb79cb10b8621 (127.27.41.131:46239), f0c9325389f84e1d8e8a1a3ced7cd321 (127.27.41.129:42849)
I20260810 06:44:25.571525 22129 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadace8b095451abc1d51fa455ade04" candidate_uuid: "c8656096a76c490596677fe66e454fe0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0c9325389f84e1d8e8a1a3ced7cd321"
I20260810 06:44:25.571511 22519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdadace8b095451abc1d51fa455ade04" candidate_uuid: "c8656096a76c490596677fe66e454fe0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82faf8985acf45afa26fb79cb10b8621"
I20260810 06:44:25.571589 22129 raft_consensus.cc:3037] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:25.571609 22519 raft_consensus.cc:3037] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:25.572331 22129 raft_consensus.cc:2454] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8656096a76c490596677fe66e454fe0 in term 1.
I20260810 06:44:25.572453 22519 raft_consensus.cc:2454] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8656096a76c490596677fe66e454fe0 in term 1.
I20260810 06:44:25.572520 22226 leader_election.cc:302] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8656096a76c490596677fe66e454fe0, f0c9325389f84e1d8e8a1a3ced7cd321; no voters:
I20260810 06:44:25.572649 22618 raft_consensus.cc:2781] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:25.572779 22618 raft_consensus.cc:686] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [term 1 LEADER]: Becoming Leader. State: Replica: c8656096a76c490596677fe66e454fe0, State: Running, Role: LEADER
I20260810 06:44:25.572897 22618 consensus_queue.cc:237] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82faf8985acf45afa26fb79cb10b8621" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46239 } } peers { permanent_uuid: "c8656096a76c490596677fe66e454fe0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37027 } } peers { permanent_uuid: "f0c9325389f84e1d8e8a1a3ced7cd321" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 42849 } }
I20260810 06:44:25.573849 21925 catalog_manager.cc:5495] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8656096a76c490596677fe66e454fe0 (127.27.41.130). New cstate: current_term: 1 leader_uuid: "c8656096a76c490596677fe66e454fe0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82faf8985acf45afa26fb79cb10b8621" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8656096a76c490596677fe66e454fe0" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 37027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0c9325389f84e1d8e8a1a3ced7cd321" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 42849 } health_report { overall_health: UNKNOWN } } }
I20260810 06:44:25.583508 22602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.581024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40174 (local address 127.27.41.130:37027)
0810 06:44:25.581087 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:25.581089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:25.581098 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:44:25.581165 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:25.581166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:25.581184 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:25.581272 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:25.581433 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.581884 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.582718 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.582920 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.582996 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.583173 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:25.583275 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:25.583369 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:25.583392 (+ 23us) server_negotiation.cc:299] Negotiation successful
0810 06:44:25.583412 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 06:44:25.585201 22129 raft_consensus.cc:1261] T cdadace8b095451abc1d51fa455ade04 P f0c9325389f84e1d8e8a1a3ced7cd321 [term 1 FOLLOWER]: Refusing update from remote peer c8656096a76c490596677fe66e454fe0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:25.585201 22519 raft_consensus.cc:1261] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621 [term 1 FOLLOWER]: Refusing update from remote peer c8656096a76c490596677fe66e454fe0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:25.585538 22618 consensus_queue.cc:1035] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82faf8985acf45afa26fb79cb10b8621" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 46239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:25.585682 22624 consensus_queue.cc:1035] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0c9325389f84e1d8e8a1a3ced7cd321" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 42849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:25.588325 22631 mvcc.cc:205] Tried to move back new op lower bound from 7316866111834423296 to 7316866111787327488. Current Snapshot: MvccSnapshot[applied={T|T < 7316866111834423296}]
I20260810 06:44:25.588435 22633 mvcc.cc:205] Tried to move back new op lower bound from 7316866111834423296 to 7316866111787327488. Current Snapshot: MvccSnapshot[applied={T|T < 7316866111834423296}]
I20260810 06:44:25.588729 22634 mvcc.cc:205] Tried to move back new op lower bound from 7316866111834423296 to 7316866111787327488. Current Snapshot: MvccSnapshot[applied={T|T < 7316866111834423296 or (T in {7316866111834423296})}]
I20260810 06:44:25.590816 21925 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:44:25.590901 21925 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:44:25.591600 21925 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bda31615fcb2435590afaf58e8af4cb0: Sending DeleteTablet for 3 replicas of tablet cdadace8b095451abc1d51fa455ade04
I20260810 06:44:25.591939 22283 tablet_service.cc:1514] Processing DeleteTablet for tablet cdadace8b095451abc1d51fa455ade04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:25 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:40170
I20260810 06:44:25.592017 22496 tablet_service.cc:1514] Processing DeleteTablet for tablet cdadace8b095451abc1d51fa455ade04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:25 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:48090
I20260810 06:44:25.592203 22644 tablet_replica.cc:330] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0: stopping tablet replica
I20260810 06:44:25.592224 22100 tablet_service.cc:1514] Processing DeleteTablet for tablet cdadace8b095451abc1d51fa455ade04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:25 UTC) from {username='kudu', principal='kudu/127.27.41.190@KRBTEST.COM'} at 127.0.0.1:35412
I20260810 06:44:25.592307 22644 raft_consensus.cc:2229] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:44:25.592229 22647 tablet_replica.cc:330] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621: stopping tablet replica
I20260810 06:44:25.592438 22644 raft_consensus.cc:2258] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:44:25.592528 22647 raft_consensus.cc:2229] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:44:25.592540 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 22016
I20260810 06:44:25.592675 22647 raft_consensus.cc:2258] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:44:25.601075 22647 ts_tablet_manager.cc:1905] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:44:25.601824 22644 ts_tablet_manager.cc:1905] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:44:25.602813 22647 ts_tablet_manager.cc:1918] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:44:25.602898 22647 log.cc:1196] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/cdadace8b095451abc1d51fa455ade04
I20260810 06:44:25.603148 22644 ts_tablet_manager.cc:1918] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:44:25.603209 22647 ts_tablet_manager.cc:1939] T cdadace8b095451abc1d51fa455ade04 P 82faf8985acf45afa26fb79cb10b8621: Deleting consensus metadata
I20260810 06:44:25.603240 22644 log.cc:1196] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/cdadace8b095451abc1d51fa455ade04
I20260810 06:44:25.603500 22644 ts_tablet_manager.cc:1939] T cdadace8b095451abc1d51fa455ade04 P c8656096a76c490596677fe66e454fe0: Deleting consensus metadata
I20260810 06:44:25.603693 21905 catalog_manager.cc:4841] TS 82faf8985acf45afa26fb79cb10b8621 (127.27.41.131:46239): tablet cdadace8b095451abc1d51fa455ade04 (table test-table [id=245b72000c4d4137840ed434808d2ed5]) successfully deleted
I20260810 06:44:25.603924 21907 catalog_manager.cc:4841] TS c8656096a76c490596677fe66e454fe0 (127.27.41.130:37027): tablet cdadace8b095451abc1d51fa455ade04 (table test-table [id=245b72000c4d4137840ed434808d2ed5]) successfully deleted
W20260810 06:44:25.609174 21905 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:42849 (error 108)
I20260810 06:44:25.609587 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 22204
I20260810 06:44:25.609752 22599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.609596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:42849 (local address 127.0.0.1:35422)
0810 06:44:25.609673 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:25.609721 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:42849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 06:44:25.617218 21905 catalog_manager.cc:4584] TS f0c9325389f84e1d8e8a1a3ced7cd321 (127.27.41.129:42849): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cdadace8b095451abc1d51fa455ade04: Network error: Client connection negotiation failed: client connection to 127.27.41.129:42849: connect: Connection refused (error 111)
I20260810 06:44:25.629197 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 22390
I20260810 06:44:25.641558 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 21880
2026-08-10T06:44:25Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2174 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-10T06:44:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:25Z Disabled control of system clock
I20260810 06:44:25.675994 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:40155
--webserver_interface=127.27.41.190
--webserver_port=0
--builtin_ntp_servers=127.27.41.148:40511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:40155
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 06:44:25.757567 22655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:25.757779 22655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:25.757799 22655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:25.758857 22655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:25.758889 22655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:25.758901 22655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:25.758914 22655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:25.758926 22655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:25.760288 22655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:40511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:40155
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:40155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:25.760489 22655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:25.760725 22655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:25.765600 22662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:25.765620 22664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:25.765610 22661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:25.765865 22655 server_base.cc:1034] running on GCE node
I20260810 06:44:25.766078 22655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:25.766307 22655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:25.767445 22655 hybrid_clock.cc:648] HybridClock initialized: now 1786344265767419 us; error 37 us; skew 500 ppm
I20260810 06:44:25.768772 22655 webserver.cc:460] Webserver started at http://127.27.41.190:42925/ using document root <none> and password file <none>
I20260810 06:44:25.769028 22655 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:25.769083 22655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:25.769266 22655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:25.770344 22655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "701c51b63f89429f9a0297d653c060db"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "f77343344093616714df54cafcf11ff8"
server_key_iv: "05009dce5e7ccf357ddc5e5cabf78c25"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.770722 22655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "701c51b63f89429f9a0297d653c060db"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "f77343344093616714df54cafcf11ff8"
server_key_iv: "05009dce5e7ccf357ddc5e5cabf78c25"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.771988 22655 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:44:25.772688 22671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.772884 22655 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:25.772972 22655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "701c51b63f89429f9a0297d653c060db"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "f77343344093616714df54cafcf11ff8"
server_key_iv: "05009dce5e7ccf357ddc5e5cabf78c25"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.773026 22655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:25.791711 22655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:25.791957 22655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:25.792057 22655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:25.795943 22655 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:40155
I20260810 06:44:25.795993 22738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:40155 every 8 connection(s)
I20260810 06:44:25.796304 22655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:25.797372 22739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:25.799711 22739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db: Bootstrap starting.
I20260810 06:44:25.800338 22739 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:25.800546 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 22655
I20260810 06:44:25.800684 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:25.800714 22739 log.cc:824] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:25.800896 27814 external_mini_cluster.cc:1428] Setting key dd59691e6ab94b4d3ef57ee0d6db35d2
I20260810 06:44:25.801710 22739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db: No bootstrap required, opened a new log
I20260810 06:44:25.804082 22739 raft_consensus.cc:348] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "701c51b63f89429f9a0297d653c060db" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40155 } }
I20260810 06:44:25.804247 22739 raft_consensus.cc:374] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:25.804278 22739 raft_consensus.cc:729] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 701c51b63f89429f9a0297d653c060db, State: Initialized, Role: FOLLOWER
I20260810 06:44:25.804384 22739 consensus_queue.cc:260] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "701c51b63f89429f9a0297d653c060db" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40155 } }
I20260810 06:44:25.804452 22739 raft_consensus.cc:388] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:25.804481 22739 raft_consensus.cc:482] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:25.804526 22739 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:25.805086 22739 raft_consensus.cc:504] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "701c51b63f89429f9a0297d653c060db" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40155 } }
I20260810 06:44:25.805202 22739 leader_election.cc:302] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 701c51b63f89429f9a0297d653c060db; no voters:
I20260810 06:44:25.805406 22739 leader_election.cc:288] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:25.805447 22746 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:25.805595 22746 raft_consensus.cc:686] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [term 1 LEADER]: Becoming Leader. State: Replica: 701c51b63f89429f9a0297d653c060db, State: Running, Role: LEADER
I20260810 06:44:25.805758 22739 sys_catalog.cc:564] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:25.805972 22746 consensus_queue.cc:237] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "701c51b63f89429f9a0297d653c060db" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40155 } }
I20260810 06:44:25.806406 22747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 701c51b63f89429f9a0297d653c060db. Latest consensus state: current_term: 1 leader_uuid: "701c51b63f89429f9a0297d653c060db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "701c51b63f89429f9a0297d653c060db" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40155 } } }
I20260810 06:44:25.806505 22747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:25.806411 22748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "701c51b63f89429f9a0297d653c060db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "701c51b63f89429f9a0297d653c060db" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 40155 } } }
I20260810 06:44:25.806650 22748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:25.806913 22745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.801485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58550 (local address 127.27.41.190:40155)
0810 06:44:25.801705 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:25.801720 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:25.801748 (+ 28us) server_negotiation.cc:407] Connection header received
0810 06:44:25.802202 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:25.802208 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:25.802262 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:25.802373 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:25.802596 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.803466 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.804603 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.805031 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.805129 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.806037 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:25.806041 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:25.806042 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:25.806217 (+ 175us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:25.806248 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:25.806259 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:25.806338 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:25.806441 (+ 103us) server_negotiation.cc:299] Negotiation successful
0810 06:44:25.806521 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":111,"threads_started":1}
I20260810 06:44:25.807003 22757 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:25.807512 22757 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:25.809098 22757 catalog_manager.cc:1347] Generated new cluster ID: 89deee1fd4e643e5ac4e2f71040a5902
I20260810 06:44:25.809165 22757 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:25.822966 22757 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:25.823473 22757 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:25.836112 22757 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db: Generated new TSK 0
I20260810 06:44:25.836311 22757 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:25.843838 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.129:0
--local_ip_for_outbound_sockets=127.27.41.129
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:40155
--builtin_ntp_servers=127.27.41.148:40511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 06:44:25.931420 22774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:25.931646 22774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:25.931681 22774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:25.932857 22774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:25.932921 22774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:25.932962 22774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.129
I20260810 06:44:25.934413 22774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:40511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.41.129
--webserver_port=0
--tserver_master_addrs=127.27.41.190:40155
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.129
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:25.934688 22774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:25.934994 22774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:25.940500 22783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:25.940505 22781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:25.940521 22785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:25.940649 22774 server_base.cc:1034] running on GCE node
I20260810 06:44:25.940863 22774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:25.941154 22774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:25.942320 22774 hybrid_clock.cc:648] HybridClock initialized: now 1786344265942295 us; error 52 us; skew 500 ppm
I20260810 06:44:25.943961 22774 webserver.cc:460] Webserver started at http://127.27.41.129:36421/ using document root <none> and password file <none>
I20260810 06:44:25.944244 22774 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:25.944322 22774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:25.944537 22774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:25.945683 22774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/data/instance:
uuid: "6a1c70958be047e3a67b62b810a8ff12"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "69f152c261824640eeb1ee7d6da2e933"
server_key_iv: "713cc838db9890b7f770a2e11b3d2780"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.946054 22774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance:
uuid: "6a1c70958be047e3a67b62b810a8ff12"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "69f152c261824640eeb1ee7d6da2e933"
server_key_iv: "713cc838db9890b7f770a2e11b3d2780"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.947364 22774 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:44:25.948093 22793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.948258 22774 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:25.948367 22774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/wal
uuid: "6a1c70958be047e3a67b62b810a8ff12"
format_stamp: "Formatted at 2026-08-10 06:44:25 on dist-test-slave-bw88"
server_key: "69f152c261824640eeb1ee7d6da2e933"
server_key_iv: "713cc838db9890b7f770a2e11b3d2780"
server_key_version: "encryptionkey@0"
I20260810 06:44:25.948439 22774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:25.969635 22774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:25.969967 22774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:25.970120 22774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:25.970383 22774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:25.970744 22774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:25.970803 22774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.970842 22774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:25.970870 22774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:25.976831 22774 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.129:41739
I20260810 06:44:25.976897 22950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.129:41739 every 8 connection(s)
I20260810 06:44:25.977246 22774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/data/info.pb
I20260810 06:44:25.980561 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 22774
I20260810 06:44:25.980683 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-0/wal/instance
I20260810 06:44:25.980887 27814 external_mini_cluster.cc:1428] Setting key 43db78e84ba86c6ac49bc4574788c319
I20260810 06:44:25.982025 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.130:0
--local_ip_for_outbound_sockets=127.27.41.130
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:40155
--builtin_ntp_servers=127.27.41.148:40511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 06:44:25.982566 22745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.977995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.129:56841 (local address 127.27.41.190:40155)
0810 06:44:25.978053 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:25.978055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:25.978286 (+ 231us) server_negotiation.cc:407] Connection header received
0810 06:44:25.978783 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:25.978783 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:25.978793 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:25.978846 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:25.979455 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.979931 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.980974 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.981328 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.981412 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.982298 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:25.982300 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:25.982300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:25.982306 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:25.982334 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:25.982338 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:25.982385 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:25.982487 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 06:44:25.982509 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 06:44:25.982862 22953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:25.977997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:40155 (local address 127.27.41.129:56841)
0810 06:44:25.978170 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:25.978203 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:25.978701 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:25.978894 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:25.978897 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:25.978905 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:25.979383 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.979386 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.980011 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.980012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.980879 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:25.980881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:25.981434 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:25.981436 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:25.981580 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:25.982110 (+ 530us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:44:25.982110 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:25.982150 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:44:25.982181 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:25.982410 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:25.982416 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:25.982419 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:44:25.982491 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 06:44:25.982603 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":90,"threads_started":1}
I20260810 06:44:25.983357 22951 heartbeater.cc:347] Connected to a master server at 127.27.41.190:40155
I20260810 06:44:25.983456 22951 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:25.983654 22951 heartbeater.cc:511] Master 127.27.41.190:40155 requested a full tablet report, sending...
I20260810 06:44:25.984256 22698 ts_manager.cc:194] Registered new tserver with Master: 6a1c70958be047e3a67b62b810a8ff12 (127.27.41.129:41739)
I20260810 06:44:25.985163 22698 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.41.129:56841
W20260810 06:44:26.065014 22954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:26.065199 22954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:26.065219 22954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:26.066330 22954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:26.066392 22954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:26.066417 22954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.130
I20260810 06:44:26.067679 22954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:40511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.41.130
--webserver_port=0
--tserver_master_addrs=127.27.41.190:40155
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.130
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:26.067880 22954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:26.068171 22954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:26.073290 22960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:26.073321 22961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:26.073460 22954 server_base.cc:1034] running on GCE node
W20260810 06:44:26.073290 22963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:26.073777 22954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:26.074043 22954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:26.075300 22954 hybrid_clock.cc:648] HybridClock initialized: now 1786344266075286 us; error 28 us; skew 500 ppm
I20260810 06:44:26.076665 22954 webserver.cc:460] Webserver started at http://127.27.41.130:38749/ using document root <none> and password file <none>
I20260810 06:44:26.076948 22954 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:26.077059 22954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:26.077210 22954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:26.078344 22954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/data/instance:
uuid: "c7830d6b880540e99525a2eb3b00f151"
format_stamp: "Formatted at 2026-08-10 06:44:26 on dist-test-slave-bw88"
server_key: "7f154b0b8de354ad1558ecb19affa9bf"
server_key_iv: "b017bbeecb8117ec145235eafb6f6a56"
server_key_version: "encryptionkey@0"
I20260810 06:44:26.078725 22954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance:
uuid: "c7830d6b880540e99525a2eb3b00f151"
format_stamp: "Formatted at 2026-08-10 06:44:26 on dist-test-slave-bw88"
server_key: "7f154b0b8de354ad1558ecb19affa9bf"
server_key_iv: "b017bbeecb8117ec145235eafb6f6a56"
server_key_version: "encryptionkey@0"
I20260810 06:44:26.080085 22954 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:44:26.080780 22970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:26.080963 22954 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:26.081063 22954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/wal
uuid: "c7830d6b880540e99525a2eb3b00f151"
format_stamp: "Formatted at 2026-08-10 06:44:26 on dist-test-slave-bw88"
server_key: "7f154b0b8de354ad1558ecb19affa9bf"
server_key_iv: "b017bbeecb8117ec145235eafb6f6a56"
server_key_version: "encryptionkey@0"
I20260810 06:44:26.081159 22954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:26.089780 22954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:26.090075 22954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:26.090221 22954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:26.090432 22954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:26.090757 22954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:26.090814 22954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:26.090853 22954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:26.090881 22954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:26.096805 22954 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.130:44487
I20260810 06:44:26.096858 23118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.130:44487 every 8 connection(s)
I20260810 06:44:26.097168 22954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/data/info.pb
I20260810 06:44:26.098362 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 22954
I20260810 06:44:26.098486 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/wal/instance
I20260810 06:44:26.098699 27814 external_mini_cluster.cc:1428] Setting key 553f6121a7c97e873f72c69bb0d58395
I20260810 06:44:26.099797 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.41.131:0
--local_ip_for_outbound_sockets=127.27.41.131
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:40155
--builtin_ntp_servers=127.27.41.148:40511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 06:44:26.103206 22745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.097925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:40027 (local address 127.27.41.190:40155)
0810 06:44:26.098029 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:26.098031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:26.098242 (+ 211us) server_negotiation.cc:407] Connection header received
0810 06:44:26.098866 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:26.098868 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:26.098881 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:26.098966 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:26.099865 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.100590 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.101718 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.101936 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.102015 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.102911 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:26.102912 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:26.102912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:26.102917 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:26.102934 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:26.102939 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:26.102992 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:26.103097 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 06:44:26.103127 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 06:44:26.103430 23123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.097885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:40155 (local address 127.27.41.130:40027)
0810 06:44:26.098122 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:26.098154 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:26.098748 (+ 594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:26.099051 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:26.099056 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:26.099066 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:26.099759 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.099765 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.100713 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.100714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.101625 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.101628 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.102036 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.102037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.102177 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.102746 (+ 569us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:44:26.102747 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:26.102776 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:44:26.102801 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:26.103003 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:26.103008 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:26.103012 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:44:26.103099 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 06:44:26.103204 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":110,"threads_started":1}
I20260810 06:44:26.103938 23120 heartbeater.cc:347] Connected to a master server at 127.27.41.190:40155
I20260810 06:44:26.104041 23120 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:26.104238 23120 heartbeater.cc:511] Master 127.27.41.190:40155 requested a full tablet report, sending...
I20260810 06:44:26.104660 22698 ts_manager.cc:194] Registered new tserver with Master: c7830d6b880540e99525a2eb3b00f151 (127.27.41.130:44487)
I20260810 06:44:26.105217 22698 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.41.130:40027
W20260810 06:44:26.182729 23125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:26.182916 23125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:26.182940 23125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:26.184077 23125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:26.184114 23125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:26.184139 23125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.41.131
I20260810 06:44:26.185472 23125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:40511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.41.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.41.131
--webserver_port=0
--tserver_master_addrs=127.27.41.190:40155
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.41.131
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:26.185659 23125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:26.185894 23125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:26.190797 23130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:26.190811 23132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:26.190783 23134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:26.191123 23125 server_base.cc:1034] running on GCE node
I20260810 06:44:26.191340 23125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:26.191571 23125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:26.192759 23125 hybrid_clock.cc:648] HybridClock initialized: now 1786344266192749 us; error 28 us; skew 500 ppm
I20260810 06:44:26.193961 23125 webserver.cc:460] Webserver started at http://127.27.41.131:35057/ using document root <none> and password file <none>
I20260810 06:44:26.194231 23125 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:26.194299 23125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:26.194446 23125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:26.195475 23125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/data/instance:
uuid: "1e84f95bcdfe4d6da033533eea57aa5d"
format_stamp: "Formatted at 2026-08-10 06:44:26 on dist-test-slave-bw88"
server_key: "c06b9f40c6bd6abc2213fba0945b579b"
server_key_iv: "86c16cb807f0853cd28512be8abc5435"
server_key_version: "encryptionkey@0"
I20260810 06:44:26.195839 23125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance:
uuid: "1e84f95bcdfe4d6da033533eea57aa5d"
format_stamp: "Formatted at 2026-08-10 06:44:26 on dist-test-slave-bw88"
server_key: "c06b9f40c6bd6abc2213fba0945b579b"
server_key_iv: "86c16cb807f0853cd28512be8abc5435"
server_key_version: "encryptionkey@0"
I20260810 06:44:26.197093 23125 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:44:26.197841 23141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:26.198014 23125 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:26.198112 23125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/wal
uuid: "1e84f95bcdfe4d6da033533eea57aa5d"
format_stamp: "Formatted at 2026-08-10 06:44:26 on dist-test-slave-bw88"
server_key: "c06b9f40c6bd6abc2213fba0945b579b"
server_key_iv: "86c16cb807f0853cd28512be8abc5435"
server_key_version: "encryptionkey@0"
I20260810 06:44:26.198192 23125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:26.218420 23125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:26.218871 23125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:26.219034 23125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:26.219278 23125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:44:26.219653 23125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:44:26.219708 23125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:26.219743 23125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:44:26.219784 23125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:26.225955 23125 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.131:45709
I20260810 06:44:26.226061 23295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.131:45709 every 8 connection(s)
I20260810 06:44:26.226377 23125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/data/info.pb
I20260810 06:44:26.231760 22745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.227185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.131:58319 (local address 127.27.41.190:40155)
0810 06:44:26.227255 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:26.227258 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:26.227517 (+ 259us) server_negotiation.cc:407] Connection header received
0810 06:44:26.228135 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:26.228136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:26.228145 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:26.228209 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:26.228921 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.229492 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.230463 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.230644 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.230694 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.231561 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:26.231562 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:26.231562 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:26.231566 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:26.231577 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:26.231580 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:26.231617 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:26.231679 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 06:44:26.231699 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 06:44:26.231968 23299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.227170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:40155 (local address 127.27.41.131:58319)
0810 06:44:26.227378 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:26.227419 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:26.228033 (+ 614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:26.228282 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:26.228286 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:26.228294 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:26.228842 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.228846 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.229576 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.229577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.230388 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.230390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.230719 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.230720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.230831 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.231433 (+ 602us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:44:26.231433 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:26.231464 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:44:26.231488 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:26.231619 (+ 131us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:26.231621 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:26.231623 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 06:44:26.231670 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 06:44:26.231751 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":107,"threads_started":1}
I20260810 06:44:26.232525 23297 heartbeater.cc:347] Connected to a master server at 127.27.41.190:40155
I20260810 06:44:26.232637 23297 heartbeater.cc:464] Registering TS with master...
I20260810 06:44:26.232822 23297 heartbeater.cc:511] Master 127.27.41.190:40155 requested a full tablet report, sending...
I20260810 06:44:26.233237 22698 ts_manager.cc:194] Registered new tserver with Master: 1e84f95bcdfe4d6da033533eea57aa5d (127.27.41.131:45709)
I20260810 06:44:26.233631 22698 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.41.131:58319
I20260810 06:44:26.236253 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 23125
I20260810 06:44:26.236394 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/wal/instance
I20260810 06:44:26.236582 27814 external_mini_cluster.cc:1428] Setting key ea41b56aec9740960839d18abe717db1
I20260810 06:44:26.237499 27814 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:44:26.241621 22745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.238907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58558 (local address 127.27.41.190:40155)
0810 06:44:26.238947 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:26.238949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:26.239089 (+ 140us) server_negotiation.cc:407] Connection header received
0810 06:44:26.239141 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:26.239142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:26.239151 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:26.239189 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:26.239324 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.239768 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.240468 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.240638 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.240685 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.241425 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:26.241426 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:26.241426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:26.241430 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:26.241441 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:26.241444 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:26.241482 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:26.241520 (+ 38us) server_negotiation.cc:299] Negotiation successful
0810 06:44:26.241540 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:44:26.243199 22698 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58558:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:44:26.244752 22698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:44:26.251463 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.247217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54278 (local address 127.27.41.131:45709)
0810 06:44:26.247404 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:26.247408 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:26.247749 (+ 341us) server_negotiation.cc:407] Connection header received
0810 06:44:26.247814 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:26.247817 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:26.247832 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:26.247934 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:26.248120 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.249164 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.250275 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.251028 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.251118 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.251274 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:26.251328 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 06:44:26.251367 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":84,"threads_started":1}
I20260810 06:44:26.251469 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.247230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:41739 (local address 127.0.0.1:38282)
0810 06:44:26.247833 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:26.247842 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:26.247885 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:26.248093 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:26.248094 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:26.248096 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:26.248142 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.248144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.248976 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.248977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.250290 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.250292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.251146 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.251146 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.251221 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.251237 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 06:44:26.251300 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 06:44:26.251365 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"mutex_wait_us":38,"thread_start_us":73,"threads_started":1}
I20260810 06:44:26.251469 23310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.247012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:45709 (local address 127.0.0.1:54278)
0810 06:44:26.247672 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:26.247682 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:26.247746 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:26.248002 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:26.248003 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:26.248005 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:26.248043 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.248044 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.249224 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.249225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.250189 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.250192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.251138 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.251139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.251221 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.251236 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 06:44:26.251312 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 06:44:26.251370 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"mutex_wait_us":29,"spinlock_wait_cycles":768,"thread_start_us":103,"threads_started":1}
I20260810 06:44:26.252483 23308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.247012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.130:44487 (local address 127.0.0.1:40134)
0810 06:44:26.247335 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:26.247376 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:26.247473 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:26.247753 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:26.247757 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:26.247760 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:26.247827 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.247828 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.249157 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.249158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.250286 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.250289 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.252189 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.252190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.252255 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.252258 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:44:26.252360 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 06:44:26.252418 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":2,"thread_start_us":75,"threads_started":1}
I20260810 06:44:26.252483 23313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.247441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38282 (local address 127.27.41.129:41739)
0810 06:44:26.247625 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:26.247629 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:26.247946 (+ 317us) server_negotiation.cc:407] Connection header received
0810 06:44:26.247996 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:26.247998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:26.248010 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:26.248094 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:26.248199 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.248885 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.250362 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.251064 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.251140 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.252310 (+ 1170us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:26.252337 (+ 27us) server_negotiation.cc:299] Negotiation successful
0810 06:44:26.252401 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":118,"threads_started":1}
I20260810 06:44:26.252534 23309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.247124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40134 (local address 127.27.41.130:44487)
0810 06:44:26.247293 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:26.247299 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:26.247453 (+ 154us) server_negotiation.cc:407] Connection header received
0810 06:44:26.247568 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:26.247570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:26.247587 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:26.247664 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:26.247915 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.249075 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.251252 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.252038 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.252119 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.252219 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:26.252404 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 06:44:26.252447 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260810 06:44:26.252596 23207 tablet_service.cc:1467] Processing CreateTablet for tablet e919240e97e84f9d84adcaca7fb71135 (DEFAULT_TABLE table=test-table [id=86e946c307fd43ba8e48e7e45f8811b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:26.253033 23207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e919240e97e84f9d84adcaca7fb71135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:26.253166 22857 tablet_service.cc:1467] Processing CreateTablet for tablet e919240e97e84f9d84adcaca7fb71135 (DEFAULT_TABLE table=test-table [id=86e946c307fd43ba8e48e7e45f8811b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:26.253530 22857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e919240e97e84f9d84adcaca7fb71135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:26.253655 23031 tablet_service.cc:1467] Processing CreateTablet for tablet e919240e97e84f9d84adcaca7fb71135 (DEFAULT_TABLE table=test-table [id=86e946c307fd43ba8e48e7e45f8811b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:44:26.254001 23031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e919240e97e84f9d84adcaca7fb71135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:26.256561 23314 tablet_bootstrap.cc:492] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151: Bootstrap starting.
I20260810 06:44:26.256809 23317 tablet_bootstrap.cc:492] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12: Bootstrap starting.
I20260810 06:44:26.257313 23314 tablet_bootstrap.cc:654] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:26.257512 23316 tablet_bootstrap.cc:492] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d: Bootstrap starting.
I20260810 06:44:26.257601 23317 tablet_bootstrap.cc:654] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:26.257741 23314 log.cc:824] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:26.257954 23317 log.cc:824] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:26.258204 23316 tablet_bootstrap.cc:654] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:26.258503 23316 log.cc:824] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:26.258599 23314 tablet_bootstrap.cc:492] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151: No bootstrap required, opened a new log
I20260810 06:44:26.258671 23314 ts_tablet_manager.cc:1397] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 06:44:26.259209 23316 tablet_bootstrap.cc:492] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d: No bootstrap required, opened a new log
I20260810 06:44:26.259290 23316 ts_tablet_manager.cc:1397] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:44:26.260650 23314 raft_consensus.cc:348] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7830d6b880540e99525a2eb3b00f151" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44487 } } peers { permanent_uuid: "1e84f95bcdfe4d6da033533eea57aa5d" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45709 } } peers { permanent_uuid: "6a1c70958be047e3a67b62b810a8ff12" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41739 } }
I20260810 06:44:26.260778 23314 raft_consensus.cc:374] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:26.260799 23314 raft_consensus.cc:729] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7830d6b880540e99525a2eb3b00f151, State: Initialized, Role: FOLLOWER
I20260810 06:44:26.260921 23314 consensus_queue.cc:260] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7830d6b880540e99525a2eb3b00f151" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44487 } } peers { permanent_uuid: "1e84f95bcdfe4d6da033533eea57aa5d" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45709 } } peers { permanent_uuid: "6a1c70958be047e3a67b62b810a8ff12" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41739 } }
I20260810 06:44:26.261229 23314 ts_tablet_manager.cc:1428] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 06:44:26.261296 23120 heartbeater.cc:503] Master 127.27.41.190:40155 was elected leader, sending a full tablet report...
I20260810 06:44:26.261575 23316 raft_consensus.cc:348] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7830d6b880540e99525a2eb3b00f151" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44487 } } peers { permanent_uuid: "1e84f95bcdfe4d6da033533eea57aa5d" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45709 } } peers { permanent_uuid: "6a1c70958be047e3a67b62b810a8ff12" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41739 } }
I20260810 06:44:26.261739 23316 raft_consensus.cc:374] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:26.261785 23316 raft_consensus.cc:729] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e84f95bcdfe4d6da033533eea57aa5d, State: Initialized, Role: FOLLOWER
I20260810 06:44:26.261823 23317 tablet_bootstrap.cc:492] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12: No bootstrap required, opened a new log
I20260810 06:44:26.261896 23317 ts_tablet_manager.cc:1397] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260810 06:44:26.261897 23316 consensus_queue.cc:260] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7830d6b880540e99525a2eb3b00f151" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44487 } } peers { permanent_uuid: "1e84f95bcdfe4d6da033533eea57aa5d" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45709 } } peers { permanent_uuid: "6a1c70958be047e3a67b62b810a8ff12" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41739 } }
I20260810 06:44:26.262197 23316 ts_tablet_manager.cc:1428] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:44:26.262276 23297 heartbeater.cc:503] Master 127.27.41.190:40155 was elected leader, sending a full tablet report...
I20260810 06:44:26.264220 23317 raft_consensus.cc:348] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7830d6b880540e99525a2eb3b00f151" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44487 } } peers { permanent_uuid: "1e84f95bcdfe4d6da033533eea57aa5d" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45709 } } peers { permanent_uuid: "6a1c70958be047e3a67b62b810a8ff12" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41739 } }
I20260810 06:44:26.264364 23317 raft_consensus.cc:374] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:26.264408 23317 raft_consensus.cc:729] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a1c70958be047e3a67b62b810a8ff12, State: Initialized, Role: FOLLOWER
I20260810 06:44:26.264528 23317 consensus_queue.cc:260] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7830d6b880540e99525a2eb3b00f151" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44487 } } peers { permanent_uuid: "1e84f95bcdfe4d6da033533eea57aa5d" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45709 } } peers { permanent_uuid: "6a1c70958be047e3a67b62b810a8ff12" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41739 } }
I20260810 06:44:26.264779 23317 ts_tablet_manager.cc:1428] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 06:44:26.264832 22951 heartbeater.cc:503] Master 127.27.41.190:40155 was elected leader, sending a full tablet report...
I20260810 06:44:26.284255 23321 raft_consensus.cc:482] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:44:26.284377 23321 raft_consensus.cc:504] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7830d6b880540e99525a2eb3b00f151" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44487 } } peers { permanent_uuid: "1e84f95bcdfe4d6da033533eea57aa5d" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45709 } } peers { permanent_uuid: "6a1c70958be047e3a67b62b810a8ff12" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41739 } }
I20260810 06:44:26.284691 23321 leader_election.cc:288] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e84f95bcdfe4d6da033533eea57aa5d (127.27.41.131:45709), 6a1c70958be047e3a67b62b810a8ff12 (127.27.41.129:41739)
I20260810 06:44:26.288410 23313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.284951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:52645 (local address 127.27.41.129:41739)
0810 06:44:26.285023 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:26.285025 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:26.285157 (+ 132us) server_negotiation.cc:407] Connection header received
0810 06:44:26.285210 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:26.285211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:26.285239 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:26.285293 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:26.285465 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.286159 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.287480 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.288026 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.288100 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.288108 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:26.288302 (+ 194us) server_negotiation.cc:299] Negotiation successful
0810 06:44:26.288341 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 06:44:26.288410 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.284893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.41.130:44829 (local address 127.27.41.131:45709)
0810 06:44:26.284961 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:26.284963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:26.284973 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:44:26.285001 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:26.285001 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:26.285012 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:26.285070 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:44:26.285258 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.286063 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.287487 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.288026 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.288100 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.288108 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:26.288302 (+ 194us) server_negotiation.cc:299] Negotiation successful
0810 06:44:26.288341 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 06:44:26.288442 23123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.284833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.131:45709 (local address 127.27.41.130:44829)
0810 06:44:26.284876 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:26.284888 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:26.284936 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:26.285080 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:26.285081 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:26.285083 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:26.285180 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.285182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.286143 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.286144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.287392 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.287396 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.288129 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.288130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.288222 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.288227 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:44:26.288285 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 06:44:26.288334 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20,"mutex_wait_us":79}
I20260810 06:44:26.288450 23324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.284855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:41739 (local address 127.27.41.130:52645)
0810 06:44:26.285092 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:26.285101 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:26.285153 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:26.285292 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:26.285293 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:26.285294 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:44:26.285395 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.285397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.286236 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.286237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.287393 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:26.287396 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.288129 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.288130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:26.288222 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.288227 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:44:26.288285 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 06:44:26.288332 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":9,"thread_start_us":134,"threads_started":1}
I20260810 06:44:26.288856 22890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e919240e97e84f9d84adcaca7fb71135" candidate_uuid: "c7830d6b880540e99525a2eb3b00f151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a1c70958be047e3a67b62b810a8ff12" is_pre_election: true
I20260810 06:44:26.288890 23237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e919240e97e84f9d84adcaca7fb71135" candidate_uuid: "c7830d6b880540e99525a2eb3b00f151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e84f95bcdfe4d6da033533eea57aa5d" is_pre_election: true
I20260810 06:44:26.289009 22890 raft_consensus.cc:2454] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7830d6b880540e99525a2eb3b00f151 in term 0.
I20260810 06:44:26.289058 23237 raft_consensus.cc:2454] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7830d6b880540e99525a2eb3b00f151 in term 0.
I20260810 06:44:26.289254 22972 leader_election.cc:302] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a1c70958be047e3a67b62b810a8ff12, c7830d6b880540e99525a2eb3b00f151; no voters:
I20260810 06:44:26.289395 23321 raft_consensus.cc:2781] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:44:26.289451 23321 raft_consensus.cc:482] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:44:26.289474 23321 raft_consensus.cc:3037] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:26.290169 23321 raft_consensus.cc:504] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7830d6b880540e99525a2eb3b00f151" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44487 } } peers { permanent_uuid: "1e84f95bcdfe4d6da033533eea57aa5d" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45709 } } peers { permanent_uuid: "6a1c70958be047e3a67b62b810a8ff12" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41739 } }
I20260810 06:44:26.290307 23321 leader_election.cc:288] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [CANDIDATE]: Term 1 election: Requested vote from peers 1e84f95bcdfe4d6da033533eea57aa5d (127.27.41.131:45709), 6a1c70958be047e3a67b62b810a8ff12 (127.27.41.129:41739)
I20260810 06:44:26.290452 22890 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e919240e97e84f9d84adcaca7fb71135" candidate_uuid: "c7830d6b880540e99525a2eb3b00f151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a1c70958be047e3a67b62b810a8ff12"
I20260810 06:44:26.290531 22890 raft_consensus.cc:3037] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:26.290571 23237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e919240e97e84f9d84adcaca7fb71135" candidate_uuid: "c7830d6b880540e99525a2eb3b00f151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e84f95bcdfe4d6da033533eea57aa5d"
I20260810 06:44:26.290642 23237 raft_consensus.cc:3037] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:26.291325 22890 raft_consensus.cc:2454] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7830d6b880540e99525a2eb3b00f151 in term 1.
I20260810 06:44:26.291381 23237 raft_consensus.cc:2454] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7830d6b880540e99525a2eb3b00f151 in term 1.
I20260810 06:44:26.291558 22975 leader_election.cc:302] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e84f95bcdfe4d6da033533eea57aa5d, c7830d6b880540e99525a2eb3b00f151; no voters:
I20260810 06:44:26.291688 23321 raft_consensus.cc:2781] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:26.291867 23321 raft_consensus.cc:686] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [term 1 LEADER]: Becoming Leader. State: Replica: c7830d6b880540e99525a2eb3b00f151, State: Running, Role: LEADER
I20260810 06:44:26.291961 23321 consensus_queue.cc:237] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7830d6b880540e99525a2eb3b00f151" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44487 } } peers { permanent_uuid: "1e84f95bcdfe4d6da033533eea57aa5d" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45709 } } peers { permanent_uuid: "6a1c70958be047e3a67b62b810a8ff12" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41739 } }
I20260810 06:44:26.292749 22698 catalog_manager.cc:5495] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7830d6b880540e99525a2eb3b00f151 (127.27.41.130). New cstate: current_term: 1 leader_uuid: "c7830d6b880540e99525a2eb3b00f151" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7830d6b880540e99525a2eb3b00f151" member_type: VOTER last_known_addr { host: "127.27.41.130" port: 44487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e84f95bcdfe4d6da033533eea57aa5d" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a1c70958be047e3a67b62b810a8ff12" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41739 } health_report { overall_health: UNKNOWN } } }
I20260810 06:44:26.297820 23309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.295669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40146 (local address 127.27.41.130:44487)
0810 06:44:26.295719 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:26.295721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:26.295726 (+ 5us) server_negotiation.cc:407] Connection header received
0810 06:44:26.295752 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:26.295753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:26.295766 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:26.295838 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:26.295944 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.296350 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.297059 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:26.297231 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:26.297311 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:26.297494 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:26.297603 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:26.297694 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:26.297712 (+ 18us) server_negotiation.cc:299] Negotiation successful
0810 06:44:26.297732 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 06:44:26.299425 22890 raft_consensus.cc:1261] T e919240e97e84f9d84adcaca7fb71135 P 6a1c70958be047e3a67b62b810a8ff12 [term 1 FOLLOWER]: Refusing update from remote peer c7830d6b880540e99525a2eb3b00f151: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:26.299436 23237 raft_consensus.cc:1261] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d [term 1 FOLLOWER]: Refusing update from remote peer c7830d6b880540e99525a2eb3b00f151: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:26.299743 23321 consensus_queue.cc:1035] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e84f95bcdfe4d6da033533eea57aa5d" member_type: VOTER last_known_addr { host: "127.27.41.131" port: 45709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:26.299882 23325 consensus_queue.cc:1035] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a1c70958be047e3a67b62b810a8ff12" member_type: VOTER last_known_addr { host: "127.27.41.129" port: 41739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:26.302269 23329 mvcc.cc:205] Tried to move back new op lower bound from 7316866114760355840 to 7316866114732515328. Current Snapshot: MvccSnapshot[applied={T|T < 7316866114760355840}]
I20260810 06:44:26.303174 23333 mvcc.cc:205] Tried to move back new op lower bound from 7316866114760355840 to 7316866114732515328. Current Snapshot: MvccSnapshot[applied={T|T < 7316866114760355840 or (T in {7316866114760355840})}]
I20260810 06:44:26.304194 22698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58558:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:44:26.304279 22698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58558:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:44:26.304986 22698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 701c51b63f89429f9a0297d653c060db: Sending DeleteTablet for 3 replicas of tablet e919240e97e84f9d84adcaca7fb71135
I20260810 06:44:26.305299 23031 tablet_service.cc:1514] Processing DeleteTablet for tablet e919240e97e84f9d84adcaca7fb71135 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:26 UTC) from {username='slave'} at 127.0.0.1:40134
I20260810 06:44:26.305385 23207 tablet_service.cc:1514] Processing DeleteTablet for tablet e919240e97e84f9d84adcaca7fb71135 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:26 UTC) from {username='slave'} at 127.0.0.1:54278
I20260810 06:44:26.305409 22857 tablet_service.cc:1514] Processing DeleteTablet for tablet e919240e97e84f9d84adcaca7fb71135 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:44:26 UTC) from {username='slave'} at 127.0.0.1:38282
I20260810 06:44:26.305548 23345 tablet_replica.cc:330] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151: stopping tablet replica
I20260810 06:44:26.305629 23345 raft_consensus.cc:2229] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:44:26.305801 23345 raft_consensus.cc:2258] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:44:26.305886 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 22774
I20260810 06:44:26.317209 23345 ts_tablet_manager.cc:1905] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:44:26.318100 23346 tablet_replica.cc:330] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d: stopping tablet replica
I20260810 06:44:26.318348 23346 raft_consensus.cc:2229] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:44:26.318576 23346 raft_consensus.cc:2258] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:44:26.319473 23345 ts_tablet_manager.cc:1918] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:44:26.319554 23345 log.cc:1196] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-1/wal/wals/e919240e97e84f9d84adcaca7fb71135
I20260810 06:44:26.319823 23345 ts_tablet_manager.cc:1939] T e919240e97e84f9d84adcaca7fb71135 P c7830d6b880540e99525a2eb3b00f151: Deleting consensus metadata
I20260810 06:44:26.320225 22675 catalog_manager.cc:4841] TS c7830d6b880540e99525a2eb3b00f151 (127.27.41.130:44487): tablet e919240e97e84f9d84adcaca7fb71135 (table test-table [id=86e946c307fd43ba8e48e7e45f8811b7]) successfully deleted
I20260810 06:44:26.320853 23346 ts_tablet_manager.cc:1905] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:44:26.322916 23346 ts_tablet_manager.cc:1918] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:44:26.323004 23346 log.cc:1196] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d: Deleting WAL directory at /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786344020082892-27814-0/minicluster-data/ts-2/wal/wals/e919240e97e84f9d84adcaca7fb71135
I20260810 06:44:26.323254 23346 ts_tablet_manager.cc:1939] T e919240e97e84f9d84adcaca7fb71135 P 1e84f95bcdfe4d6da033533eea57aa5d: Deleting consensus metadata
I20260810 06:44:26.323998 22679 catalog_manager.cc:4841] TS 1e84f95bcdfe4d6da033533eea57aa5d (127.27.41.131:45709): tablet e919240e97e84f9d84adcaca7fb71135 (table test-table [id=86e946c307fd43ba8e48e7e45f8811b7]) successfully deleted
W20260810 06:44:26.328835 22675 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.41.129:41739 (error 108)
I20260810 06:44:26.329123 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 22954
I20260810 06:44:26.330619 23308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:26.329217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.129:41739 (local address 127.0.0.1:38286)
0810 06:44:26.330530 (+ 1313us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:26.330577 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.129:41739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1287}
W20260810 06:44:26.343811 22675 catalog_manager.cc:4584] TS 6a1c70958be047e3a67b62b810a8ff12 (127.27.41.129:41739): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e919240e97e84f9d84adcaca7fb71135: Network error: Client connection negotiation failed: client connection to 127.27.41.129:41739: connect: Connection refused (error 111)
I20260810 06:44:26.347841 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 23125
I20260810 06:44:26.358827 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 22655
2026-08-10T06:44:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (714 ms)
[----------] 6 tests from EncryptionPolicyTest (9156 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:26 dist-test-slave-bw88 krb5kdc[23353](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:26 dist-test-slave-bw88 krb5kdc[23353](info): set up 2 sockets
Aug 10 06:44:26 dist-test-slave-bw88 krb5kdc[23353](info): commencing operation
krb5kdc: starting...
W20260810 06:44:27.560178 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:27 dist-test-slave-bw88 krb5kdc[23353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:44:27.688022 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36849
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:27.770768 23367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:27.771019 23367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:27.771057 23367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:27.772166 23367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:27.772234 23367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:27.772257 23367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:27.772277 23367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:27.772306 23367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:27.773888 23367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36849
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:27.774166 23367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:27.774407 23367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:27.779455 23374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:27.779474 23367 server_base.cc:1034] running on GCE node
W20260810 06:44:27.779484 23375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:27.779457 23377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:27.779989 23367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:27.780298 23367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:27.781513 23367 hybrid_clock.cc:648] HybridClock initialized: now 1786344267781493 us; error 45 us; skew 500 ppm
Aug 10 06:44:27 dist-test-slave-bw88 krb5kdc[23353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344267, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:27.787933 23367 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:44:27.788405 23367 webserver.cc:460] Webserver started at http://127.0.0.1:33263/ using document root <none> and password file <none>
I20260810 06:44:27.788636 23367 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:27.788704 23367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:27.788875 23367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:27.790057 23367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "83febc43a6cd451a82b19c02c582feda"
format_stamp: "Formatted at 2026-08-10 06:44:27 on dist-test-slave-bw88"
server_key: "aec8c822bf2439d5bee3e2d622d6f358"
server_key_iv: "ff20d7a0900084fe0003a3be644cb631"
server_key_version: "encryptionkey@0"
I20260810 06:44:27.790438 23367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "83febc43a6cd451a82b19c02c582feda"
format_stamp: "Formatted at 2026-08-10 06:44:27 on dist-test-slave-bw88"
server_key: "aec8c822bf2439d5bee3e2d622d6f358"
server_key_iv: "ff20d7a0900084fe0003a3be644cb631"
server_key_version: "encryptionkey@0"
I20260810 06:44:27.791821 23367 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 06:44:27.792555 23386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:27.792747 23367 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:27.792860 23367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "83febc43a6cd451a82b19c02c582feda"
format_stamp: "Formatted at 2026-08-10 06:44:27 on dist-test-slave-bw88"
server_key: "aec8c822bf2439d5bee3e2d622d6f358"
server_key_iv: "ff20d7a0900084fe0003a3be644cb631"
server_key_version: "encryptionkey@0"
I20260810 06:44:27.792933 23367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:27.802187 23367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:27.804355 23367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:27.804508 23367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:27.808694 23367 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36849
I20260810 06:44:27.808725 23462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36849 every 8 connection(s)
I20260810 06:44:27.809132 23367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:27.810020 23464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:27.812187 23464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda: Bootstrap starting.
I20260810 06:44:27.812723 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 23367
I20260810 06:44:27.812736 23464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:27.812875 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:27.813062 27814 external_mini_cluster.cc:1428] Setting key 84e2e208950e13ff94c9c8fc08fcd972
I20260810 06:44:27.813062 23464 log.cc:824] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:27.813977 23464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda: No bootstrap required, opened a new log
I20260810 06:44:27.816607 23464 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83febc43a6cd451a82b19c02c582feda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } }
I20260810 06:44:27.816774 23464 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:27.816811 23464 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83febc43a6cd451a82b19c02c582feda, State: Initialized, Role: FOLLOWER
I20260810 06:44:27.816934 23464 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83febc43a6cd451a82b19c02c582feda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } }
I20260810 06:44:27.817003 23464 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:27.817029 23464 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:27.817072 23464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:27.817729 23464 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83febc43a6cd451a82b19c02c582feda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } }
I20260810 06:44:27.817819 23464 leader_election.cc:302] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83febc43a6cd451a82b19c02c582feda; no voters:
I20260810 06:44:27.818012 23464 leader_election.cc:288] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:27.818104 23473 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:27.818295 23473 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [term 1 LEADER]: Becoming Leader. State: Replica: 83febc43a6cd451a82b19c02c582feda, State: Running, Role: LEADER
I20260810 06:44:27.818275 23464 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:27.818439 23473 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83febc43a6cd451a82b19c02c582feda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } }
I20260810 06:44:27.820053 23475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83febc43a6cd451a82b19c02c582feda. Latest consensus state: current_term: 1 leader_uuid: "83febc43a6cd451a82b19c02c582feda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83febc43a6cd451a82b19c02c582feda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } } }
I20260810 06:44:27.819973 23474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83febc43a6cd451a82b19c02c582feda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83febc43a6cd451a82b19c02c582feda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36849 } } }
I20260810 06:44:27.820214 23475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:27.820218 23474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda [sys.catalog]: This master's current role is: LEADER
Aug 10 06:44:27 dist-test-slave-bw88 krb5kdc[23353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
W20260810 06:44:27.820492 23492 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:44:27.820545 23492 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:44:27.820672 23494 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:27.820896 23494 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:27.822669 23494 catalog_manager.cc:1347] Generated new cluster ID: 069a9f03a16f496bb053cb19d82373de
I20260810 06:44:27.822719 23494 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:27.824731 23472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:27.813639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41173 (local address 127.0.0.1:36849)
0810 06:44:27.813785 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:27.813806 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:27.813970 (+ 164us) server_negotiation.cc:407] Connection header received
0810 06:44:27.814520 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:27.814526 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:27.814579 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:27.814691 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:27.815483 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:27.816343 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:27.817435 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:27.817887 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:27.818027 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:27.821012 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:27.821016 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:27.821017 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:27.821029 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:27.823018 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:27.823468 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:27.823471 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:27.823472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:27.823584 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:27.823829 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:27.823830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:27.823831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:27.824135 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:27.824299 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:27.824393 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 06:44:27.824498 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":76,"threads_started":1}
I20260810 06:44:27.825779 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:27.839972 23494 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:27.840518 23494 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:27.844915 23472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:27.827111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43435 (local address 127.0.0.1:36849)
0810 06:44:27.827144 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:27.827146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:27.837523 (+ 10377us) server_negotiation.cc:407] Connection header received
0810 06:44:27.837583 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:27.837584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:27.837595 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:27.837656 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:27.838273 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:27.839339 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:27.840299 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:27.840641 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:27.840713 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:27.842095 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:27.842097 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:27.842097 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:27.842104 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:27.843669 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:27.844108 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:27.844109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:27.844110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:27.844172 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:27.844401 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:27.844402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:27.844402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:27.844528 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:27.844642 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:27.844763 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 06:44:27.844828 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 06:44:27.846501 23494 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83febc43a6cd451a82b19c02c582feda: Generated new TSK 0
I20260810 06:44:27.846686 23494 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:27.849543 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 23367
W20260810 06:44:27.861724 23351 connection.cc:535] client connection to 127.0.0.1:36849 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36849): Connection reset by peer (error 104)
2026-08-10T06:44:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1493 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:27 dist-test-slave-bw88 krb5kdc[23505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:27 dist-test-slave-bw88 krb5kdc[23505](info): set up 2 sockets
Aug 10 06:44:27 dist-test-slave-bw88 krb5kdc[23505](info): commencing operation
krb5kdc: starting...
W20260810 06:44:29.048192 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:29 dist-test-slave-bw88 krb5kdc[23505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344269, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:44:29.169955 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45427
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45427
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:29.252117 23521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:29.252400 23521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:29.252441 23521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:29.253702 23521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:29.253779 23521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:29.253803 23521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:29.253825 23521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:29.253852 23521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:29.255347 23521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45427
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:29.255645 23521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:29.255884 23521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:29.261013 23532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:29.261130 23521 server_base.cc:1034] running on GCE node
W20260810 06:44:29.261018 23535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:29.261045 23533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:29.261597 23521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:29.261933 23521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:29.263108 23521 hybrid_clock.cc:648] HybridClock initialized: now 1786344269263088 us; error 33 us; skew 500 ppm
Aug 10 06:44:29 dist-test-slave-bw88 krb5kdc[23505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344269, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:29.265650 23521 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:44:29.266137 23521 webserver.cc:460] Webserver started at http://127.0.0.1:39229/ using document root <none> and password file <none>
I20260810 06:44:29.266393 23521 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:29.266463 23521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:29.266616 23521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:29.267666 23521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "a26a3d60d3f449a8964ab278c2ee4147"
format_stamp: "Formatted at 2026-08-10 06:44:29 on dist-test-slave-bw88"
server_key: "dd405f3e4fbd72c80ad82cf3716550a3"
server_key_iv: "8e856e973b72512075dd4c7042cf0ae6"
server_key_version: "encryptionkey@0"
I20260810 06:44:29.268033 23521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "a26a3d60d3f449a8964ab278c2ee4147"
format_stamp: "Formatted at 2026-08-10 06:44:29 on dist-test-slave-bw88"
server_key: "dd405f3e4fbd72c80ad82cf3716550a3"
server_key_iv: "8e856e973b72512075dd4c7042cf0ae6"
server_key_version: "encryptionkey@0"
I20260810 06:44:29.269480 23521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:44:29.270259 23547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:29.270435 23521 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:29.270548 23521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "a26a3d60d3f449a8964ab278c2ee4147"
format_stamp: "Formatted at 2026-08-10 06:44:29 on dist-test-slave-bw88"
server_key: "dd405f3e4fbd72c80ad82cf3716550a3"
server_key_iv: "8e856e973b72512075dd4c7042cf0ae6"
server_key_version: "encryptionkey@0"
I20260810 06:44:29.270624 23521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:29.280855 23521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:29.282770 23521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:29.282932 23521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:29.287127 23521 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45427
I20260810 06:44:29.287158 23617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45427 every 8 connection(s)
I20260810 06:44:29.287489 23521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:29.288296 23618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:29.290508 23618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147: Bootstrap starting.
I20260810 06:44:29.291010 23618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:29.291249 23618 log.cc:824] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:29.291898 23618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147: No bootstrap required, opened a new log
I20260810 06:44:29.293489 23618 raft_consensus.cc:348] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a26a3d60d3f449a8964ab278c2ee4147" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45427 } }
I20260810 06:44:29.293629 23618 raft_consensus.cc:374] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:29.293653 23618 raft_consensus.cc:729] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26a3d60d3f449a8964ab278c2ee4147, State: Initialized, Role: FOLLOWER
I20260810 06:44:29.293748 23618 consensus_queue.cc:260] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a26a3d60d3f449a8964ab278c2ee4147" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45427 } }
I20260810 06:44:29.293828 23618 raft_consensus.cc:388] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:29.293866 23618 raft_consensus.cc:482] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:29.293939 23618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:29.294502 23618 raft_consensus.cc:504] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a26a3d60d3f449a8964ab278c2ee4147" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45427 } }
I20260810 06:44:29.294628 23618 leader_election.cc:302] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a26a3d60d3f449a8964ab278c2ee4147; no voters:
I20260810 06:44:29.294817 23618 leader_election.cc:288] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:29.294858 23623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:29.294939 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 23521
I20260810 06:44:29.295037 23623 raft_consensus.cc:686] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [term 1 LEADER]: Becoming Leader. State: Replica: a26a3d60d3f449a8964ab278c2ee4147, State: Running, Role: LEADER
I20260810 06:44:29.295089 23618 sys_catalog.cc:564] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:29.295109 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:29.295141 23623 consensus_queue.cc:237] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a26a3d60d3f449a8964ab278c2ee4147" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45427 } }
I20260810 06:44:29.295337 27814 external_mini_cluster.cc:1428] Setting key f76a7514659758e220f206d95b4f7a89
I20260810 06:44:29.295480 23623 sys_catalog.cc:455] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a26a3d60d3f449a8964ab278c2ee4147. Latest consensus state: current_term: 1 leader_uuid: "a26a3d60d3f449a8964ab278c2ee4147" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a26a3d60d3f449a8964ab278c2ee4147" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45427 } } }
I20260810 06:44:29.295558 23623 sys_catalog.cc:458] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:29.295634 23624 sys_catalog.cc:455] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a26a3d60d3f449a8964ab278c2ee4147" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a26a3d60d3f449a8964ab278c2ee4147" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45427 } } }
I20260810 06:44:29.295719 23624 sys_catalog.cc:458] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147 [sys.catalog]: This master's current role is: LEADER
W20260810 06:44:29.297055 23643 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:44:29.297117 23643 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:44:29.297176 23632 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:29.297330 23632 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:29.299739 23632 catalog_manager.cc:1347] Generated new cluster ID: d6c61b3da43549309b4ebb06dcae8ec4
I20260810 06:44:29.299795 23632 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:29.301267 23636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:29.295965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55063 (local address 127.0.0.1:45427)
0810 06:44:29.296198 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:29.296208 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:29.296248 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:44:29.296376 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:29.296385 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:29.296481 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:29.297000 (+ 519us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:29.297069 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:29.298295 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:29.299387 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:29.299898 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:29.299978 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:29.300612 (+ 634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:29.300616 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:29.300617 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:29.300771 (+ 154us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:29.300800 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:29.300810 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:29.300875 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:29.301001 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 06:44:29.301030 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":99,"threads_started":1}
I20260810 06:44:29.302263 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:29.307031 23636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:29.303688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43217 (local address 127.0.0.1:45427)
0810 06:44:29.303723 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:29.303724 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:29.303882 (+ 158us) server_negotiation.cc:407] Connection header received
0810 06:44:29.303921 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:29.303922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:29.303931 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:29.303995 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:29.304091 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:29.304795 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:29.305798 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:29.306103 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:29.306174 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:29.306806 (+ 632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:29.306807 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:29.306807 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:29.306812 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:29.306826 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:29.306830 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:29.306893 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:29.306956 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 06:44:29.306967 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 06:44:29.309147 23632 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:29.309712 23632 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:29.313884 23632 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a26a3d60d3f449a8964ab278c2ee4147: Generated new TSK 0
I20260810 06:44:29.314056 23632 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:29.317866 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 23521
W20260810 06:44:29.335165 23503 connection.cc:535] client connection to 127.0.0.1:45427 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45427): Connection reset by peer (error 104)
2026-08-10T06:44:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1473 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:29 dist-test-slave-bw88 krb5kdc[23659](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:29 dist-test-slave-bw88 krb5kdc[23659](info): set up 2 sockets
Aug 10 06:44:29 dist-test-slave-bw88 krb5kdc[23659](info): commencing operation
krb5kdc: starting...
W20260810 06:44:30.522550 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:30 dist-test-slave-bw88 krb5kdc[23659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:44:30.644261 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35535
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35535
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:30.727931 23676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:30.728194 23676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:30.728233 23676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:30.729439 23676 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:30.729513 23676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:30.729537 23676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:30.729558 23676 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:30.729590 23676 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:30.731086 23676 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35535
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:30.731376 23676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:30.731607 23676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:30.736840 23682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:30.736797 23685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:30.736817 23683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:30.736949 23676 server_base.cc:1034] running on GCE node
I20260810 06:44:30.737380 23676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:30.737706 23676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:30.738852 23676 hybrid_clock.cc:648] HybridClock initialized: now 1786344270738840 us; error 30 us; skew 500 ppm
Aug 10 06:44:30 dist-test-slave-bw88 krb5kdc[23659](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344270, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:30.741375 23676 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:44:30.741834 23676 webserver.cc:460] Webserver started at http://127.0.0.1:34175/ using document root <none> and password file <none>
I20260810 06:44:30.742080 23676 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:30.742128 23676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:30.742295 23676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:30.743343 23676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "0efff8682c77472cafa84da89b46b04f"
format_stamp: "Formatted at 2026-08-10 06:44:30 on dist-test-slave-bw88"
server_key: "8a96056c7c0a858958e118fcb093c147"
server_key_iv: "1470ccbf3f00561c33ec0dcb44f3a072"
server_key_version: "encryptionkey@0"
I20260810 06:44:30.743718 23676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "0efff8682c77472cafa84da89b46b04f"
format_stamp: "Formatted at 2026-08-10 06:44:30 on dist-test-slave-bw88"
server_key: "8a96056c7c0a858958e118fcb093c147"
server_key_iv: "1470ccbf3f00561c33ec0dcb44f3a072"
server_key_version: "encryptionkey@0"
I20260810 06:44:30.745041 23676 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:44:30.745831 23692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:30.746021 23676 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:30.746121 23676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "0efff8682c77472cafa84da89b46b04f"
format_stamp: "Formatted at 2026-08-10 06:44:30 on dist-test-slave-bw88"
server_key: "8a96056c7c0a858958e118fcb093c147"
server_key_iv: "1470ccbf3f00561c33ec0dcb44f3a072"
server_key_version: "encryptionkey@0"
I20260810 06:44:30.746191 23676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:30.750029 23676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:30.752015 23676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:30.752173 23676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:30.756364 23676 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35535
I20260810 06:44:30.756397 23764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35535 every 8 connection(s)
I20260810 06:44:30.756740 23676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:30.757818 23765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:30.759631 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 23676
I20260810 06:44:30.759776 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:30.759974 27814 external_mini_cluster.cc:1428] Setting key a0bc2f465620afa372cb32d69ab9eb6d
I20260810 06:44:30.760295 23765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f: Bootstrap starting.
I20260810 06:44:30.761287 23765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:30.761667 23765 log.cc:824] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:30.762578 23765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f: No bootstrap required, opened a new log
I20260810 06:44:30.762674 23769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:30.760503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33973 (local address 127.0.0.1:35535)
0810 06:44:30.760688 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:30.760697 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:30.760729 (+ 32us) server_negotiation.cc:407] Connection header received
0810 06:44:30.761386 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:30.761395 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:30.761433 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:30.761604 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:30.762209 (+ 605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:30.762213 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:30.762214 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:30.762218 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:30.762261 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:30.762275 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:30.762367 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:30.762419 (+ 52us) server_negotiation.cc:299] Negotiation successful
0810 06:44:30.762476 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
I20260810 06:44:30.763722 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:30.765127 23765 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efff8682c77472cafa84da89b46b04f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35535 } }
I20260810 06:44:30.765306 23765 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:30.765372 23765 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efff8682c77472cafa84da89b46b04f, State: Initialized, Role: FOLLOWER
I20260810 06:44:30.765496 23765 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efff8682c77472cafa84da89b46b04f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35535 } }
I20260810 06:44:30.765614 23765 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:30.765652 23765 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:30.765700 23765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:30.766238 23769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:30.765033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37539 (local address 127.0.0.1:35535)
0810 06:44:30.765068 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:30.765069 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:30.765211 (+ 142us) server_negotiation.cc:407] Connection header received
0810 06:44:30.765289 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:30.765290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:30.765295 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:30.765395 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:30.766014 (+ 619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:30.766016 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:30.766016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:30.766020 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:30.766034 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:30.766038 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:30.766095 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:30.766161 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 06:44:30.766175 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 06:44:30.766360 23765 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efff8682c77472cafa84da89b46b04f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35535 } }
I20260810 06:44:30.766472 23765 leader_election.cc:302] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0efff8682c77472cafa84da89b46b04f; no voters:
I20260810 06:44:30.766644 23765 leader_election.cc:288] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:30.766670 23777 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:30.766861 23777 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [term 1 LEADER]: Becoming Leader. State: Replica: 0efff8682c77472cafa84da89b46b04f, State: Running, Role: LEADER
I20260810 06:44:30.766963 23765 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:30.766995 23777 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efff8682c77472cafa84da89b46b04f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35535 } }
I20260810 06:44:30.767470 23778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0efff8682c77472cafa84da89b46b04f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efff8682c77472cafa84da89b46b04f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35535 } } }
I20260810 06:44:30.767590 23778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:30.767791 23781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0efff8682c77472cafa84da89b46b04f. Latest consensus state: current_term: 1 leader_uuid: "0efff8682c77472cafa84da89b46b04f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efff8682c77472cafa84da89b46b04f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35535 } } }
I20260810 06:44:30.767905 23781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:30.768095 23789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:30.768574 23789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:30.770164 23789 catalog_manager.cc:1347] Generated new cluster ID: bbbd1643f0f44b26aaf34baac52770ed
I20260810 06:44:30.770220 23789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:30.816326 23789 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:30.816541 23789 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:30.820744 23789 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0efff8682c77472cafa84da89b46b04f: Generated new TSK 0
I20260810 06:44:30.820940 23789 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:30.827275 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 23676
2026-08-10T06:44:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1501 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:30 dist-test-slave-bw88 krb5kdc[23809](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:30 dist-test-slave-bw88 krb5kdc[23809](info): set up 2 sockets
Aug 10 06:44:30 dist-test-slave-bw88 krb5kdc[23809](info): commencing operation
krb5kdc: starting...
W20260810 06:44:32.049952 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:32 dist-test-slave-bw88 krb5kdc[23809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:44:32.183444 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44889
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44889
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:32.264369 23828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:32.264596 23828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:32.264635 23828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:32.265761 23828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:32.265827 23828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:32.265852 23828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:32.265885 23828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:32.265935 23828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:32.267376 23828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44889
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:32.267652 23828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:32.267882 23828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:32.272753 23837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:32.272737 23844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:32.272728 23840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:32.273324 23828 server_base.cc:1034] running on GCE node
I20260810 06:44:32.273572 23828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:32.273801 23828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:32.274991 23828 hybrid_clock.cc:648] HybridClock initialized: now 1786344272274977 us; error 32 us; skew 500 ppm
Aug 10 06:44:32 dist-test-slave-bw88 krb5kdc[23809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344272, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:32.277504 23828 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:44:32.277964 23828 webserver.cc:460] Webserver started at http://127.0.0.1:44627/ using document root <none> and password file <none>
I20260810 06:44:32.278208 23828 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:32.278276 23828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:32.278424 23828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:32.279378 23828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "a157efcd5c7f447b9689d3dfbb64388a"
format_stamp: "Formatted at 2026-08-10 06:44:32 on dist-test-slave-bw88"
server_key: "33d48102d4070eb1b6d9773804298d69"
server_key_iv: "4e859fac6c7d154e85176cf6ae425ee8"
server_key_version: "encryptionkey@0"
I20260810 06:44:32.279738 23828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "a157efcd5c7f447b9689d3dfbb64388a"
format_stamp: "Formatted at 2026-08-10 06:44:32 on dist-test-slave-bw88"
server_key: "33d48102d4070eb1b6d9773804298d69"
server_key_iv: "4e859fac6c7d154e85176cf6ae425ee8"
server_key_version: "encryptionkey@0"
I20260810 06:44:32.281000 23828 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:44:32.281821 23851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:32.281991 23828 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:32.282109 23828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "a157efcd5c7f447b9689d3dfbb64388a"
format_stamp: "Formatted at 2026-08-10 06:44:32 on dist-test-slave-bw88"
server_key: "33d48102d4070eb1b6d9773804298d69"
server_key_iv: "4e859fac6c7d154e85176cf6ae425ee8"
server_key_version: "encryptionkey@0"
I20260810 06:44:32.282183 23828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:32.292851 23828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:32.294656 23828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:32.294816 23828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:32.299041 23828 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44889
I20260810 06:44:32.299065 23915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44889 every 8 connection(s)
I20260810 06:44:32.299394 23828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:32.300207 23916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:32.302347 23916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a: Bootstrap starting.
I20260810 06:44:32.302862 23916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:32.303105 23916 log.cc:824] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:32.303752 23916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a: No bootstrap required, opened a new log
I20260810 06:44:32.305253 23916 raft_consensus.cc:348] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a157efcd5c7f447b9689d3dfbb64388a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44889 } }
I20260810 06:44:32.305403 23916 raft_consensus.cc:374] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:32.305428 23916 raft_consensus.cc:729] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a157efcd5c7f447b9689d3dfbb64388a, State: Initialized, Role: FOLLOWER
I20260810 06:44:32.305521 23916 consensus_queue.cc:260] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a157efcd5c7f447b9689d3dfbb64388a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44889 } }
I20260810 06:44:32.305603 23916 raft_consensus.cc:388] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:32.305636 23916 raft_consensus.cc:482] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:32.305692 23916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:32.306190 23916 raft_consensus.cc:504] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a157efcd5c7f447b9689d3dfbb64388a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44889 } }
I20260810 06:44:32.306314 23916 leader_election.cc:302] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a157efcd5c7f447b9689d3dfbb64388a; no voters:
I20260810 06:44:32.306490 23916 leader_election.cc:288] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:32.306551 23923 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:32.306717 23923 raft_consensus.cc:686] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [term 1 LEADER]: Becoming Leader. State: Replica: a157efcd5c7f447b9689d3dfbb64388a, State: Running, Role: LEADER
I20260810 06:44:32.306738 23916 sys_catalog.cc:564] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:32.306802 23923 consensus_queue.cc:237] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a157efcd5c7f447b9689d3dfbb64388a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44889 } }
I20260810 06:44:32.307193 23927 sys_catalog.cc:455] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a157efcd5c7f447b9689d3dfbb64388a. Latest consensus state: current_term: 1 leader_uuid: "a157efcd5c7f447b9689d3dfbb64388a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a157efcd5c7f447b9689d3dfbb64388a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44889 } } }
I20260810 06:44:32.307283 23927 sys_catalog.cc:458] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:32.307312 23926 sys_catalog.cc:455] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a157efcd5c7f447b9689d3dfbb64388a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a157efcd5c7f447b9689d3dfbb64388a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44889 } } }
I20260810 06:44:32.307413 23926 sys_catalog.cc:458] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:32.307642 23936 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:32.308162 23936 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:32.308272 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 23828
I20260810 06:44:32.308422 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:32.308640 27814 external_mini_cluster.cc:1428] Setting key 19feab28fe2d249b9cf35d122e03a743
I20260810 06:44:32.309669 23936 catalog_manager.cc:1347] Generated new cluster ID: e1705705e9f143009e5eb86f4137af9c
I20260810 06:44:32.309722 23936 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:44:32 dist-test-slave-bw88 krb5kdc[23809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 06:44:32.321368 23936 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:32.322028 23936 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:32.326349 23951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:32.309114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50359 (local address 127.0.0.1:44889)
0810 06:44:32.309455 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:32.309464 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:32.309496 (+ 32us) server_negotiation.cc:407] Connection header received
0810 06:44:32.309615 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:32.309621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:32.313459 (+ 3838us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:32.313599 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:32.314250 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:32.315184 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:32.315971 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:32.316441 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:32.316563 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:32.318923 (+ 2360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:32.318927 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:32.318927 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:32.318937 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:32.320566 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:32.320973 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:32.320976 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:32.320976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:32.321111 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:32.325461 (+ 4350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:32.325462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:32.325462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:32.325668 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:32.325837 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:32.325949 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 06:44:32.326127 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":88,"threads_started":1}
I20260810 06:44:32.327277 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:32.328650 23936 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a157efcd5c7f447b9689d3dfbb64388a: Generated new TSK 0
I20260810 06:44:32.328817 23936 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:32.335079 23951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:32.328635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56925 (local address 127.0.0.1:44889)
0810 06:44:32.328710 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:32.328712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:32.328901 (+ 189us) server_negotiation.cc:407] Connection header received
0810 06:44:32.328925 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:32.328926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:32.328936 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:32.328998 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:32.329655 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:32.330119 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:32.331131 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:32.331343 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:32.331389 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:32.332681 (+ 1292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:32.332682 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:32.332683 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:32.332688 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:32.334035 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:32.334412 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:32.334412 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:32.334413 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:32.334459 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:32.334656 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:32.334656 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:32.334656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:32.334741 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:32.334816 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:32.334967 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 06:44:32.335027 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 06:44:32.337148 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 23828
2026-08-10T06:44:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1513 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:32 dist-test-slave-bw88 krb5kdc[23962](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:32 dist-test-slave-bw88 krb5kdc[23962](info): set up 2 sockets
Aug 10 06:44:32 dist-test-slave-bw88 krb5kdc[23962](info): commencing operation
krb5kdc: starting...
W20260810 06:44:33.539386 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:33 dist-test-slave-bw88 krb5kdc[23962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:44:33.657819 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46281
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:33.739634 23979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:33.739866 23979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:33.739902 23979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:33.740988 23979 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:33.741050 23979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:33.741073 23979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:33.741092 23979 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:33.741161 23979 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:33.742664 23979 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:33.742930 23979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:33.743181 23979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:33.748039 23986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:33.748054 23989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:33.748060 23987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:33.748214 23979 server_base.cc:1034] running on GCE node
I20260810 06:44:33.748533 23979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:33.748852 23979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:33.750022 23979 hybrid_clock.cc:648] HybridClock initialized: now 1786344273750001 us; error 32 us; skew 500 ppm
Aug 10 06:44:33 dist-test-slave-bw88 krb5kdc[23962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344273, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:33.758577 23979 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:44:33.759004 23979 webserver.cc:460] Webserver started at http://127.0.0.1:40479/ using document root <none> and password file <none>
I20260810 06:44:33.759253 23979 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:33.759323 23979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:33.759471 23979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:33.760495 23979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "105a3ba1117d42cd8b70dd2eca30f764"
format_stamp: "Formatted at 2026-08-10 06:44:33 on dist-test-slave-bw88"
server_key: "95d3cfa690f7b36e91ebe215196fb920"
server_key_iv: "9d6a917d1d22c727bc619ed76507ab6a"
server_key_version: "encryptionkey@0"
I20260810 06:44:33.760851 23979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "105a3ba1117d42cd8b70dd2eca30f764"
format_stamp: "Formatted at 2026-08-10 06:44:33 on dist-test-slave-bw88"
server_key: "95d3cfa690f7b36e91ebe215196fb920"
server_key_iv: "9d6a917d1d22c727bc619ed76507ab6a"
server_key_version: "encryptionkey@0"
I20260810 06:44:33.762303 23979 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:44:33.763064 24000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:33.763250 23979 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:33.763355 23979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "105a3ba1117d42cd8b70dd2eca30f764"
format_stamp: "Formatted at 2026-08-10 06:44:33 on dist-test-slave-bw88"
server_key: "95d3cfa690f7b36e91ebe215196fb920"
server_key_iv: "9d6a917d1d22c727bc619ed76507ab6a"
server_key_version: "encryptionkey@0"
I20260810 06:44:33.763439 23979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:33.774091 23979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:33.776335 23979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:33.776497 23979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:33.780546 23979 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46281
I20260810 06:44:33.780594 24076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46281 every 8 connection(s)
I20260810 06:44:33.780958 23979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:33.781908 24077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:33.782474 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 23979
I20260810 06:44:33.782626 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:33.782816 27814 external_mini_cluster.cc:1428] Setting key bff9e58cbadd9944bbc1c83f3345930a
I20260810 06:44:33.785037 24077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764: Bootstrap starting.
I20260810 06:44:33.785744 24077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:33.786062 24077 log.cc:824] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:33.786823 24077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764: No bootstrap required, opened a new log
I20260810 06:44:33.788694 24082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:33.783345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39441 (local address 127.0.0.1:46281)
0810 06:44:33.783551 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:33.783561 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:33.783593 (+ 32us) server_negotiation.cc:407] Connection header received
0810 06:44:33.784167 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:33.784176 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:33.784238 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:33.784383 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:33.784548 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:33.785930 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:33.786736 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:33.787315 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:33.787429 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:33.788007 (+ 578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:33.788011 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:33.788011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:33.788212 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:33.788247 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:33.788262 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:33.788332 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:33.788393 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 06:44:33.788456 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":81,"threads_started":1}
I20260810 06:44:33.789064 24077 raft_consensus.cc:348] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "105a3ba1117d42cd8b70dd2eca30f764" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46281 } }
I20260810 06:44:33.789189 24077 raft_consensus.cc:374] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:33.789243 24077 raft_consensus.cc:729] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 105a3ba1117d42cd8b70dd2eca30f764, State: Initialized, Role: FOLLOWER
I20260810 06:44:33.789372 24077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "105a3ba1117d42cd8b70dd2eca30f764" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46281 } }
I20260810 06:44:33.789476 24077 raft_consensus.cc:388] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:33.789520 24077 raft_consensus.cc:482] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:33.789567 24077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:33.789829 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:33.790158 24077 raft_consensus.cc:504] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "105a3ba1117d42cd8b70dd2eca30f764" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46281 } }
I20260810 06:44:33.790274 24077 leader_election.cc:302] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 105a3ba1117d42cd8b70dd2eca30f764; no voters:
I20260810 06:44:33.790443 24077 leader_election.cc:288] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:33.790490 24085 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:33.790654 24085 raft_consensus.cc:686] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [term 1 LEADER]: Becoming Leader. State: Replica: 105a3ba1117d42cd8b70dd2eca30f764, State: Running, Role: LEADER
I20260810 06:44:33.790710 24077 sys_catalog.cc:564] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:33.792241 24085 consensus_queue.cc:237] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "105a3ba1117d42cd8b70dd2eca30f764" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46281 } }
I20260810 06:44:33.792842 24088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 105a3ba1117d42cd8b70dd2eca30f764. Latest consensus state: current_term: 1 leader_uuid: "105a3ba1117d42cd8b70dd2eca30f764" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "105a3ba1117d42cd8b70dd2eca30f764" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46281 } } }
I20260810 06:44:33.792851 24090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "105a3ba1117d42cd8b70dd2eca30f764" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "105a3ba1117d42cd8b70dd2eca30f764" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46281 } } }
W20260810 06:44:33.793224 24119 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260810 06:44:33.793612 24088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:33.793617 24090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764 [sys.catalog]: This master's current role is: LEADER
W20260810 06:44:33.793628 24119 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:44:33.793998 24122 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:33.794248 24122 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:33.794750 24082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:33.791356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35137 (local address 127.0.0.1:46281)
0810 06:44:33.791392 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:33.791394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:33.791503 (+ 109us) server_negotiation.cc:407] Connection header received
0810 06:44:33.791554 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:33.791555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:33.791568 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:33.791646 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:33.791807 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:33.792515 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:33.793547 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:33.793823 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:33.793892 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:33.794511 (+ 619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:33.794512 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:33.794512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:33.794516 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:33.794529 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:33.794533 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:33.794587 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:33.794654 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 06:44:33.794676 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 06:44:33.795946 24122 catalog_manager.cc:1347] Generated new cluster ID: c7309d40514a4f138d55c886a4175e4e
I20260810 06:44:33.796008 24122 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:33.804590 24122 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:33.805085 24122 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:33.812711 24122 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 105a3ba1117d42cd8b70dd2eca30f764: Generated new TSK 0
I20260810 06:44:33.812882 24122 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:33.816743 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 23979
2026-08-10T06:44:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1477 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:33 dist-test-slave-bw88 krb5kdc[24126](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:33 dist-test-slave-bw88 krb5kdc[24126](info): set up 2 sockets
Aug 10 06:44:33 dist-test-slave-bw88 krb5kdc[24126](info): commencing operation
krb5kdc: starting...
W20260810 06:44:35.060307 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:35 dist-test-slave-bw88 krb5kdc[24126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:44:35.178311 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40239
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:35.260330 24146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:35.260557 24146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:35.260603 24146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:35.261830 24146 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:35.261893 24146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:35.261919 24146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:35.261940 24146 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:35.261969 24146 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:35.263423 24146 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:35.263696 24146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:35.263916 24146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:35.268922 24153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:35.268949 24152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:35.268922 24158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:35.269147 24146 server_base.cc:1034] running on GCE node
I20260810 06:44:35.269443 24146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:35.269773 24146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:35.270941 24146 hybrid_clock.cc:648] HybridClock initialized: now 1786344275270931 us; error 40 us; skew 500 ppm
Aug 10 06:44:35 dist-test-slave-bw88 krb5kdc[24126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344275, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:35.273440 24146 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:44:35.273873 24146 webserver.cc:460] Webserver started at http://127.0.0.1:38481/ using document root <none> and password file <none>
I20260810 06:44:35.274048 24146 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:35.274086 24146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:35.274180 24146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:35.275125 24146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "5a7526ffe2a5451788daa55b327bb322"
format_stamp: "Formatted at 2026-08-10 06:44:35 on dist-test-slave-bw88"
server_key: "473540a4571f41ce6901db8dbb7b77d7"
server_key_iv: "271347a8a36896fde46949c0c23068d6"
server_key_version: "encryptionkey@0"
I20260810 06:44:35.275421 24146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "5a7526ffe2a5451788daa55b327bb322"
format_stamp: "Formatted at 2026-08-10 06:44:35 on dist-test-slave-bw88"
server_key: "473540a4571f41ce6901db8dbb7b77d7"
server_key_iv: "271347a8a36896fde46949c0c23068d6"
server_key_version: "encryptionkey@0"
I20260810 06:44:35.276645 24146 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:44:35.277316 24166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:35.277508 24146 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:35.277594 24146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "5a7526ffe2a5451788daa55b327bb322"
format_stamp: "Formatted at 2026-08-10 06:44:35 on dist-test-slave-bw88"
server_key: "473540a4571f41ce6901db8dbb7b77d7"
server_key_iv: "271347a8a36896fde46949c0c23068d6"
server_key_version: "encryptionkey@0"
I20260810 06:44:35.277647 24146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:35.280716 24146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:35.282469 24146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:35.282577 24146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:35.286345 24146 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40239
I20260810 06:44:35.286394 24240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40239 every 8 connection(s)
I20260810 06:44:35.286693 24146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:35.287667 24244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:35.289901 24244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322: Bootstrap starting.
I20260810 06:44:35.290460 24244 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:35.290751 24244 log.cc:824] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:35.291450 24244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322: No bootstrap required, opened a new log
I20260810 06:44:35.292939 24244 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7526ffe2a5451788daa55b327bb322" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40239 } }
I20260810 06:44:35.293110 24244 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:35.293119 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 24146
I20260810 06:44:35.293175 24244 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7526ffe2a5451788daa55b327bb322, State: Initialized, Role: FOLLOWER
I20260810 06:44:35.293249 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:35.293398 24244 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7526ffe2a5451788daa55b327bb322" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40239 } }
I20260810 06:44:35.293493 24244 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:35.293496 27814 external_mini_cluster.cc:1428] Setting key 6d1f6a8e7d356be4432bf1a791515dfd
I20260810 06:44:35.293536 24244 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:35.293583 24244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:35.294647 24244 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7526ffe2a5451788daa55b327bb322" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40239 } }
I20260810 06:44:35.294754 24244 leader_election.cc:302] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a7526ffe2a5451788daa55b327bb322; no voters:
I20260810 06:44:35.294896 24244 leader_election.cc:288] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:35.294996 24253 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:35.295151 24244 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:35.295164 24253 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [term 1 LEADER]: Becoming Leader. State: Replica: 5a7526ffe2a5451788daa55b327bb322, State: Running, Role: LEADER
I20260810 06:44:35.295298 24253 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7526ffe2a5451788daa55b327bb322" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40239 } }
I20260810 06:44:35.295650 24252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:35.293987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60473 (local address 127.0.0.1:40239)
0810 06:44:35.294195 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:35.294202 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:35.294226 (+ 24us) server_negotiation.cc:407] Connection header received
0810 06:44:35.294313 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:35.294318 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:35.294339 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:35.294443 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:35.295156 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:35.295160 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:35.295160 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:35.295166 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:35.295212 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:35.295227 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:35.295268 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:35.295415 (+ 147us) server_negotiation.cc:299] Negotiation successful
0810 06:44:35.295454 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":124,"threads_started":1}
I20260810 06:44:35.295722 24254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a7526ffe2a5451788daa55b327bb322" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7526ffe2a5451788daa55b327bb322" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40239 } } }
I20260810 06:44:35.295804 24254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:35.295948 24255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a7526ffe2a5451788daa55b327bb322. Latest consensus state: current_term: 1 leader_uuid: "5a7526ffe2a5451788daa55b327bb322" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7526ffe2a5451788daa55b327bb322" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40239 } } }
I20260810 06:44:35.296020 24255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:35.296033 24267 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:35.296828 24267 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:35.297021 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:35.299521 24252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:35.298510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60301 (local address 127.0.0.1:40239)
0810 06:44:35.298545 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:35.298546 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:35.298679 (+ 133us) server_negotiation.cc:407] Connection header received
0810 06:44:35.298706 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:35.298707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:35.298712 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:35.298779 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:35.299320 (+ 541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:35.299322 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:35.299322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:35.299326 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:35.299338 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:35.299343 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:35.299421 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:35.299437 (+ 16us) server_negotiation.cc:299] Negotiation successful
0810 06:44:35.299449 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:44:35.301916 24267 catalog_manager.cc:1347] Generated new cluster ID: ae4ba86a7e944677b909cf7c4b736b85
I20260810 06:44:35.301970 24267 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:35.307305 24267 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:35.307449 24267 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:35.311151 24267 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a7526ffe2a5451788daa55b327bb322: Generated new TSK 0
I20260810 06:44:35.311344 24267 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:35.314082 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 24146
2026-08-10T06:44:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1498 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:35 dist-test-slave-bw88 krb5kdc[24289](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:35 dist-test-slave-bw88 krb5kdc[24289](info): set up 2 sockets
Aug 10 06:44:35 dist-test-slave-bw88 krb5kdc[24289](info): commencing operation
krb5kdc: starting...
W20260810 06:44:36.504333 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:36 dist-test-slave-bw88 krb5kdc[24289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:44:36.630398 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34999
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34999
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:36.713507 24310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:36.713704 24310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:36.713727 24310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:36.714818 24310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:36.714856 24310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:36.714871 24310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:36.714884 24310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:36.714896 24310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:36.716282 24310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:36.716464 24310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:36.716625 24310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:36.721558 24322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:36.721652 24318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:36.721601 24319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:36.721621 24310 server_base.cc:1034] running on GCE node
I20260810 06:44:36.722003 24310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:36.722306 24310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:36.723476 24310 hybrid_clock.cc:648] HybridClock initialized: now 1786344276723462 us; error 46 us; skew 500 ppm
Aug 10 06:44:36 dist-test-slave-bw88 krb5kdc[24289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344276, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:36.725953 24310 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:44:36.726430 24310 webserver.cc:460] Webserver started at http://127.0.0.1:38057/ using document root <none> and password file <none>
I20260810 06:44:36.726653 24310 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:36.726720 24310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:36.726872 24310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:36.727886 24310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "b4cb2a0c064844eea1155889d4e97ee1"
format_stamp: "Formatted at 2026-08-10 06:44:36 on dist-test-slave-bw88"
server_key: "099b0e9c8eabdafd492745ce8dcedac7"
server_key_iv: "16d0714a9b4c88095042ec372773045d"
server_key_version: "encryptionkey@0"
I20260810 06:44:36.728286 24310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "b4cb2a0c064844eea1155889d4e97ee1"
format_stamp: "Formatted at 2026-08-10 06:44:36 on dist-test-slave-bw88"
server_key: "099b0e9c8eabdafd492745ce8dcedac7"
server_key_iv: "16d0714a9b4c88095042ec372773045d"
server_key_version: "encryptionkey@0"
I20260810 06:44:36.729683 24310 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:44:36.730429 24339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:36.730594 24310 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:36.730703 24310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "b4cb2a0c064844eea1155889d4e97ee1"
format_stamp: "Formatted at 2026-08-10 06:44:36 on dist-test-slave-bw88"
server_key: "099b0e9c8eabdafd492745ce8dcedac7"
server_key_iv: "16d0714a9b4c88095042ec372773045d"
server_key_version: "encryptionkey@0"
I20260810 06:44:36.730792 24310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:36.743642 24310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:36.745474 24310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:36.745635 24310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:36.749841 24310 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34999
I20260810 06:44:36.749876 24407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34999 every 8 connection(s)
I20260810 06:44:36.750222 24310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:36.751117 24408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:36.753525 24408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1: Bootstrap starting.
I20260810 06:44:36.754114 24408 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:36.754426 24408 log.cc:824] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:36.755146 24408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1: No bootstrap required, opened a new log
I20260810 06:44:36.755658 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 24310
I20260810 06:44:36.755797 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:36.755973 27814 external_mini_cluster.cc:1428] Setting key 23b124b6a481f0d7630d6fe4a7e4f0ed
I20260810 06:44:36.757375 24408 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4cb2a0c064844eea1155889d4e97ee1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34999 } }
I20260810 06:44:36.757550 24408 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:36.757575 24408 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4cb2a0c064844eea1155889d4e97ee1, State: Initialized, Role: FOLLOWER
I20260810 06:44:36.757728 24408 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4cb2a0c064844eea1155889d4e97ee1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34999 } }
I20260810 06:44:36.757812 24408 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:36.757899 24408 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:36.757961 24408 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:36.758704 24408 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4cb2a0c064844eea1155889d4e97ee1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34999 } }
I20260810 06:44:36.758795 24408 leader_election.cc:302] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4cb2a0c064844eea1155889d4e97ee1; no voters:
I20260810 06:44:36.758972 24408 leader_election.cc:288] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:36.759013 24414 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:36.759178 24414 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [term 1 LEADER]: Becoming Leader. State: Replica: b4cb2a0c064844eea1155889d4e97ee1, State: Running, Role: LEADER
I20260810 06:44:36.759235 24408 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:36.759325 24414 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4cb2a0c064844eea1155889d4e97ee1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34999 } }
I20260810 06:44:36.760447 24420 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4cb2a0c064844eea1155889d4e97ee1. Latest consensus state: current_term: 1 leader_uuid: "b4cb2a0c064844eea1155889d4e97ee1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4cb2a0c064844eea1155889d4e97ee1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34999 } } }
I20260810 06:44:36.760550 24420 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:36.760752 24415 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4cb2a0c064844eea1155889d4e97ee1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4cb2a0c064844eea1155889d4e97ee1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34999 } } }
I20260810 06:44:36.760810 24415 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:36.760983 24446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:36.761518 24446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:36.763525 24446 catalog_manager.cc:1347] Generated new cluster ID: 383b2f20fdff4d4f9e73f136ceb57c0f
I20260810 06:44:36.763579 24446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:44:36 dist-test-slave-bw88 krb5kdc[24289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 06:44:36.767755 24413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:36.756600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.189:59989 (local address 127.0.0.1:34999)
0810 06:44:36.756782 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:36.756790 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:36.756815 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:44:36.757597 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:36.757607 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:36.757695 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:36.757854 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:36.758660 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:36.760009 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:36.761170 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:36.761725 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:36.761843 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:36.764457 (+ 2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:36.764461 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:36.764462 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:36.764474 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:36.766205 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:36.766606 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:36.766609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:36.766609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:36.766699 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:36.766934 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:36.766935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:36.766936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:36.767168 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:36.767356 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:36.767466 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 06:44:36.767579 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":99,"threads_started":1}
I20260810 06:44:36.768936 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:36.769052 24446 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:36.769737 24446 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:36.777032 24446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4cb2a0c064844eea1155889d4e97ee1: Generated new TSK 0
I20260810 06:44:36.777192 24446 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:36.783572 24413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:36.776998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.189:35715 (local address 127.0.0.1:34999)
0810 06:44:36.777068 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:36.777070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:36.777569 (+ 499us) server_negotiation.cc:407] Connection header received
0810 06:44:36.777634 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:36.777635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:36.777646 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:36.777703 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:36.778220 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:36.778737 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:36.779438 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:36.779666 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:36.779756 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:36.780936 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:36.780938 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:36.780938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:36.780945 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:36.782393 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:36.782773 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:36.782774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:36.782774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:36.782836 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:36.783073 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:36.783073 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:36.783074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:36.783182 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:36.783293 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:36.783418 (+ 125us) server_negotiation.cc:299] Negotiation successful
0810 06:44:36.783481 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:44:36.785462 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 24310
W20260810 06:44:36.799065 24286 connection.cc:535] client connection to 127.0.0.1:34999 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34999): Connection reset by peer (error 104)
2026-08-10T06:44:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1472 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:36 dist-test-slave-bw88 krb5kdc[24458](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:36 dist-test-slave-bw88 krb5kdc[24458](info): set up 2 sockets
Aug 10 06:44:36 dist-test-slave-bw88 krb5kdc[24458](info): commencing operation
krb5kdc: starting...
W20260810 06:44:37.981736 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:38 dist-test-slave-bw88 krb5kdc[24458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:44:38.105803 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36535
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36535
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:38.188297 24473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:38.188540 24473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:38.188578 24473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:38.189781 24473 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:38.189844 24473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:38.189867 24473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:38.189888 24473 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:38.189916 24473 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:38.191416 24473 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36535
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:38.191704 24473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:38.191947 24473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:38.196983 24478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:38.197012 24481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:38.196960 24479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:38.197144 24473 server_base.cc:1034] running on GCE node
I20260810 06:44:38.197480 24473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:38.197777 24473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:38.198946 24473 hybrid_clock.cc:648] HybridClock initialized: now 1786344278198931 us; error 30 us; skew 500 ppm
Aug 10 06:44:38 dist-test-slave-bw88 krb5kdc[24458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344278, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:38.201551 24473 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:44:38.202032 24473 webserver.cc:460] Webserver started at http://127.0.0.1:34771/ using document root <none> and password file <none>
I20260810 06:44:38.202258 24473 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:38.202329 24473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:38.202487 24473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:38.203506 24473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "8dbe816c00f54e3eb4db12ec259f6253"
format_stamp: "Formatted at 2026-08-10 06:44:38 on dist-test-slave-bw88"
server_key: "a7583b63ec3c31e08dd6c8ebafc04107"
server_key_iv: "be7ec86cc76f534b21fc690d93d5d4eb"
server_key_version: "encryptionkey@0"
I20260810 06:44:38.203890 24473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "8dbe816c00f54e3eb4db12ec259f6253"
format_stamp: "Formatted at 2026-08-10 06:44:38 on dist-test-slave-bw88"
server_key: "a7583b63ec3c31e08dd6c8ebafc04107"
server_key_iv: "be7ec86cc76f534b21fc690d93d5d4eb"
server_key_version: "encryptionkey@0"
I20260810 06:44:38.205220 24473 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:44:38.206027 24490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:38.206200 24473 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:38.206321 24473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "8dbe816c00f54e3eb4db12ec259f6253"
format_stamp: "Formatted at 2026-08-10 06:44:38 on dist-test-slave-bw88"
server_key: "a7583b63ec3c31e08dd6c8ebafc04107"
server_key_iv: "be7ec86cc76f534b21fc690d93d5d4eb"
server_key_version: "encryptionkey@0"
I20260810 06:44:38.206413 24473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:38.217298 24473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:38.219560 24473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:38.219667 24473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:38.223968 24473 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36535
I20260810 06:44:38.223999 24557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36535 every 8 connection(s)
I20260810 06:44:38.224339 24473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:38.225241 24558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:38.227481 24558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253: Bootstrap starting.
I20260810 06:44:38.228036 24558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:38.228274 24558 log.cc:824] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:38.229009 24558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253: No bootstrap required, opened a new log
I20260810 06:44:38.230607 24558 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dbe816c00f54e3eb4db12ec259f6253" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36535 } }
I20260810 06:44:38.230811 24558 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:38.230854 24558 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbe816c00f54e3eb4db12ec259f6253, State: Initialized, Role: FOLLOWER
I20260810 06:44:38.230850 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 24473
I20260810 06:44:38.230975 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:38.231051 24558 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dbe816c00f54e3eb4db12ec259f6253" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36535 } }
I20260810 06:44:38.231144 24558 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:38.231177 24558 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:38.231187 27814 external_mini_cluster.cc:1428] Setting key 8d721149c6161bcaa7fce2c185ea6b2d
I20260810 06:44:38.231231 24558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:38.232342 24558 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dbe816c00f54e3eb4db12ec259f6253" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36535 } }
I20260810 06:44:38.232455 24558 leader_election.cc:302] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8dbe816c00f54e3eb4db12ec259f6253; no voters:
I20260810 06:44:38.232638 24558 leader_election.cc:288] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:38.232720 24569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:38.232929 24569 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [term 1 LEADER]: Becoming Leader. State: Replica: 8dbe816c00f54e3eb4db12ec259f6253, State: Running, Role: LEADER
I20260810 06:44:38.232910 24558 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:38.233120 24569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dbe816c00f54e3eb4db12ec259f6253" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36535 } }
I20260810 06:44:38.233553 24570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8dbe816c00f54e3eb4db12ec259f6253" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dbe816c00f54e3eb4db12ec259f6253" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36535 } } }
I20260810 06:44:38.233628 24570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:38.233580 24572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8dbe816c00f54e3eb4db12ec259f6253. Latest consensus state: current_term: 1 leader_uuid: "8dbe816c00f54e3eb4db12ec259f6253" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dbe816c00f54e3eb4db12ec259f6253" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36535 } } }
I20260810 06:44:38.233670 24572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:38.234360 24579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:38.234891 24579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:38.236620 24579 catalog_manager.cc:1347] Generated new cluster ID: 7ee9a62c3cf34661a2c0c77a9a83c2b4
I20260810 06:44:38.236675 24579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:38.237315 24568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:38.231686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.189:39003 (local address 127.0.0.1:36535)
0810 06:44:38.231928 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:38.231940 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:38.231981 (+ 41us) server_negotiation.cc:407] Connection header received
0810 06:44:38.232118 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:38.232125 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:38.232183 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:38.232331 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:38.232563 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:38.234029 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:38.235154 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:38.235731 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:38.235859 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:38.236608 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:38.236612 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:38.236612 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:38.236838 (+ 226us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:38.236874 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:38.236887 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:38.236963 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:38.237099 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 06:44:38.237123 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":120,"threads_started":1}
I20260810 06:44:38.242085 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:38.243765 24579 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:38.244236 24579 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:38.248876 24568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:38.243592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.189:36969 (local address 127.0.0.1:36535)
0810 06:44:38.243640 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:38.243642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:38.245537 (+ 1895us) server_negotiation.cc:407] Connection header received
0810 06:44:38.245580 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:38.245581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:38.245593 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:38.245647 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:38.245789 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:38.246570 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:38.247559 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:38.247890 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:38.247963 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:38.248619 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:38.248620 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:38.248620 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:38.248625 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:38.248642 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:38.248646 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:38.248710 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:38.248791 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 06:44:38.248805 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 06:44:38.251894 24579 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8dbe816c00f54e3eb4db12ec259f6253: Generated new TSK 0
I20260810 06:44:38.252077 24579 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:38.258021 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 24473
W20260810 06:44:38.270781 24456 connection.cc:535] client connection to 127.0.0.1:36535 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36535): Connection reset by peer (error 104)
2026-08-10T06:44:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1471 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:38 dist-test-slave-bw88 krb5kdc[24604](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:38 dist-test-slave-bw88 krb5kdc[24604](info): set up 2 sockets
Aug 10 06:44:38 dist-test-slave-bw88 krb5kdc[24604](info): commencing operation
krb5kdc: starting...
W20260810 06:44:39.451267 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:39 dist-test-slave-bw88 krb5kdc[24604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:44:39.570000 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39479
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39479
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:39.652691 24633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:39.652896 24633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:39.652920 24633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:39.654112 24633 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:39.654194 24633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:39.654220 24633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:39.654251 24633 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:39.654273 24633 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:39.655727 24633 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39479
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:39.655984 24633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:39.656217 24633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:39.661346 24644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:39.661388 24641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:39.661445 24633 server_base.cc:1034] running on GCE node
W20260810 06:44:39.661388 24640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:39.661826 24633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:39.662076 24633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:39.663242 24633 hybrid_clock.cc:648] HybridClock initialized: now 1786344279663228 us; error 45 us; skew 500 ppm
Aug 10 06:44:39 dist-test-slave-bw88 krb5kdc[24604](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344279, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:39.671907 24633 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:44:39.672354 24633 webserver.cc:460] Webserver started at http://127.0.0.1:38613/ using document root <none> and password file <none>
I20260810 06:44:39.672591 24633 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:39.672662 24633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:39.672817 24633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:39.673972 24633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "8b91599c7c054a3793e9f135b9a224f0"
format_stamp: "Formatted at 2026-08-10 06:44:39 on dist-test-slave-bw88"
server_key: "ed290121fa91d4b619c82db2de130ad5"
server_key_iv: "3f0cbe57fb25dd6fb7cb4fb3276f94b4"
server_key_version: "encryptionkey@0"
I20260810 06:44:39.674347 24633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "8b91599c7c054a3793e9f135b9a224f0"
format_stamp: "Formatted at 2026-08-10 06:44:39 on dist-test-slave-bw88"
server_key: "ed290121fa91d4b619c82db2de130ad5"
server_key_iv: "3f0cbe57fb25dd6fb7cb4fb3276f94b4"
server_key_version: "encryptionkey@0"
I20260810 06:44:39.675691 24633 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:44:39.676406 24652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:39.676609 24633 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:39.676700 24633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "8b91599c7c054a3793e9f135b9a224f0"
format_stamp: "Formatted at 2026-08-10 06:44:39 on dist-test-slave-bw88"
server_key: "ed290121fa91d4b619c82db2de130ad5"
server_key_iv: "3f0cbe57fb25dd6fb7cb4fb3276f94b4"
server_key_version: "encryptionkey@0"
I20260810 06:44:39.676754 24633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:39.680234 24633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:39.682442 24633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:39.682548 24633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:39.686565 24633 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39479
I20260810 06:44:39.686655 24720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39479 every 8 connection(s)
I20260810 06:44:39.686950 24633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:39.687958 24721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:39.690266 24721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0: Bootstrap starting.
I20260810 06:44:39.690860 24721 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:39.691159 24721 log.cc:824] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:39.691879 24721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0: No bootstrap required, opened a new log
I20260810 06:44:39.693581 24721 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b91599c7c054a3793e9f135b9a224f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39479 } }
I20260810 06:44:39.693743 24721 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:39.693796 24721 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b91599c7c054a3793e9f135b9a224f0, State: Initialized, Role: FOLLOWER
I20260810 06:44:39.693984 24721 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b91599c7c054a3793e9f135b9a224f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39479 } }
I20260810 06:44:39.694087 24721 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:39.694132 24721 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:39.694188 24721 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:39.694711 24721 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b91599c7c054a3793e9f135b9a224f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39479 } }
I20260810 06:44:39.694831 24721 leader_election.cc:302] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b91599c7c054a3793e9f135b9a224f0; no voters:
I20260810 06:44:39.694852 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 24633
I20260810 06:44:39.694993 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:39.695042 24721 leader_election.cc:288] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:39.695080 24724 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:39.695209 27814 external_mini_cluster.cc:1428] Setting key c7032b0bd0bbfe9c33e20798f43920ff
I20260810 06:44:39.695233 24724 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [term 1 LEADER]: Becoming Leader. State: Replica: 8b91599c7c054a3793e9f135b9a224f0, State: Running, Role: LEADER
I20260810 06:44:39.695319 24724 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b91599c7c054a3793e9f135b9a224f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39479 } }
I20260810 06:44:39.695356 24721 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:39.695616 24724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b91599c7c054a3793e9f135b9a224f0. Latest consensus state: current_term: 1 leader_uuid: "8b91599c7c054a3793e9f135b9a224f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b91599c7c054a3793e9f135b9a224f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39479 } } }
I20260810 06:44:39.695753 24725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b91599c7c054a3793e9f135b9a224f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b91599c7c054a3793e9f135b9a224f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39479 } } }
I20260810 06:44:39.695832 24724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:39.695935 24725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:39.696120 24731 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:39.696682 24731 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:39.698127 24733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:39.696043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.189:49605 (local address 127.0.0.1:39479)
0810 06:44:39.696465 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:39.696474 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:39.696506 (+ 32us) server_negotiation.cc:407] Connection header received
0810 06:44:39.696630 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:39.696637 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:39.696667 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:39.697077 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:39.697579 (+ 502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:39.697582 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:39.697583 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:39.697586 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:39.697635 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:39.697648 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:39.697717 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:39.697911 (+ 194us) server_negotiation.cc:299] Negotiation successful
0810 06:44:39.697958 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":66,"threads_started":1}
I20260810 06:44:39.698897 24731 catalog_manager.cc:1347] Generated new cluster ID: b599c2fb722340ab83e3b1ddb0051c05
I20260810 06:44:39.698952 24731 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:39.699100 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:39.702426 24733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:39.700616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.189:45321 (local address 127.0.0.1:39479)
0810 06:44:39.700667 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:39.700668 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:39.701524 (+ 856us) server_negotiation.cc:407] Connection header received
0810 06:44:39.701562 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:39.701564 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:39.701570 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:39.701641 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:39.702208 (+ 567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:39.702210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:39.702210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:39.702215 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:39.702231 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:39.702236 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:39.702299 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:39.702355 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 06:44:39.702367 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 06:44:39.725903 24731 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:39.726111 24731 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:39.732475 24731 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b91599c7c054a3793e9f135b9a224f0: Generated new TSK 0
I20260810 06:44:39.732676 24731 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:39.744035 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 24633
2026-08-10T06:44:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1483 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:39 dist-test-slave-bw88 krb5kdc[24763](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:39 dist-test-slave-bw88 krb5kdc[24763](info): set up 2 sockets
Aug 10 06:44:39 dist-test-slave-bw88 krb5kdc[24763](info): commencing operation
krb5kdc: starting...
W20260810 06:44:40.931236 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:41 dist-test-slave-bw88 krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:44:41.052384 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42769
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42769
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:41.135980 24780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:41.136238 24780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:41.136279 24780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:41.137567 24780 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:41.137645 24780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:41.137670 24780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:41.137696 24780 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:41.137725 24780 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:41.139281 24780 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42769
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:41.139562 24780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:41.139786 24780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:41.144683 24785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:41.144691 24786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:41.144794 24780 server_base.cc:1034] running on GCE node
W20260810 06:44:41.145092 24792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:41.145478 24780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:41.145835 24780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:41.146996 24780 hybrid_clock.cc:648] HybridClock initialized: now 1786344281146994 us; error 37 us; skew 500 ppm
Aug 10 06:44:41 dist-test-slave-bw88 krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344281, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:41.149627 24780 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:44:41.150056 24780 webserver.cc:460] Webserver started at http://127.0.0.1:34563/ using document root <none> and password file <none>
I20260810 06:44:41.150309 24780 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:41.150378 24780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:41.150542 24780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:41.151631 24780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "40962ba5f861482685350766c83e09cc"
format_stamp: "Formatted at 2026-08-10 06:44:41 on dist-test-slave-bw88"
server_key: "f8a38ff9f35faffde9b564ed8d577aa4"
server_key_iv: "8e5ffa0925bca2a5a34f1398cb36d682"
server_key_version: "encryptionkey@0"
I20260810 06:44:41.152010 24780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "40962ba5f861482685350766c83e09cc"
format_stamp: "Formatted at 2026-08-10 06:44:41 on dist-test-slave-bw88"
server_key: "f8a38ff9f35faffde9b564ed8d577aa4"
server_key_iv: "8e5ffa0925bca2a5a34f1398cb36d682"
server_key_version: "encryptionkey@0"
I20260810 06:44:41.153458 24780 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:44:41.154207 24800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:41.154374 24780 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:41.154477 24780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "40962ba5f861482685350766c83e09cc"
format_stamp: "Formatted at 2026-08-10 06:44:41 on dist-test-slave-bw88"
server_key: "f8a38ff9f35faffde9b564ed8d577aa4"
server_key_iv: "8e5ffa0925bca2a5a34f1398cb36d682"
server_key_version: "encryptionkey@0"
I20260810 06:44:41.154570 24780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:41.166541 24780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:41.168936 24780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:41.169107 24780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:41.173060 24780 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42769
I20260810 06:44:41.173127 24871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42769 every 8 connection(s)
I20260810 06:44:41.173544 24780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:41.174417 24872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:41.176632 24872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc: Bootstrap starting.
I20260810 06:44:41.177204 24872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:41.177433 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 24780
I20260810 06:44:41.177565 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:41.177556 24872 log.cc:824] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:41.177788 27814 external_mini_cluster.cc:1428] Setting key d289a5d3d97585d7c39f4ec7a77d508e
I20260810 06:44:41.178473 24872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc: No bootstrap required, opened a new log
I20260810 06:44:41.180619 24872 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40962ba5f861482685350766c83e09cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42769 } }
I20260810 06:44:41.180775 24872 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:41.180840 24872 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40962ba5f861482685350766c83e09cc, State: Initialized, Role: FOLLOWER
I20260810 06:44:41.180971 24872 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40962ba5f861482685350766c83e09cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42769 } }
I20260810 06:44:41.181078 24872 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:41.181123 24872 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:41.181183 24872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:41.181810 24872 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40962ba5f861482685350766c83e09cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42769 } }
I20260810 06:44:41.181938 24872 leader_election.cc:302] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40962ba5f861482685350766c83e09cc; no voters:
I20260810 06:44:41.182148 24872 leader_election.cc:288] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:41.182183 24880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:41.182379 24880 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [term 1 LEADER]: Becoming Leader. State: Replica: 40962ba5f861482685350766c83e09cc, State: Running, Role: LEADER
I20260810 06:44:41.182451 24872 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:41.182528 24880 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40962ba5f861482685350766c83e09cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42769 } }
I20260810 06:44:41.182972 24882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40962ba5f861482685350766c83e09cc. Latest consensus state: current_term: 1 leader_uuid: "40962ba5f861482685350766c83e09cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40962ba5f861482685350766c83e09cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42769 } } }
I20260810 06:44:41.182979 24881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40962ba5f861482685350766c83e09cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40962ba5f861482685350766c83e09cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42769 } } }
I20260810 06:44:41.183157 24881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:41.183173 24882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:41.183462 24890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:41.184008 24890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 06:44:41 dist-test-slave-bw88 krb5kdc[24763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 06:44:41.185575 24890 catalog_manager.cc:1347] Generated new cluster ID: c32dfa00279446c0a7aa788626c61a8c
I20260810 06:44:41.185627 24890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:41.189587 24878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:41.178294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.189:48425 (local address 127.0.0.1:42769)
0810 06:44:41.178495 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:41.178505 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:41.178554 (+ 49us) server_negotiation.cc:407] Connection header received
0810 06:44:41.179005 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:41.179011 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:41.179058 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:41.179221 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:41.179854 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:41.180712 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:41.181726 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:41.182319 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:41.182452 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:41.185826 (+ 3374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:41.185829 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:41.185830 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:41.185843 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:41.187812 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:41.188276 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:41.188279 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:41.188279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:41.188388 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:41.188625 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:41.188626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:41.188626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:41.188930 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:41.189101 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:41.189216 (+ 115us) server_negotiation.cc:299] Negotiation successful
0810 06:44:41.189327 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":99,"threads_started":1}
I20260810 06:44:41.190876 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:41.194285 24890 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:41.194772 24890 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:41.198410 24890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40962ba5f861482685350766c83e09cc: Generated new TSK 0
I20260810 06:44:41.198612 24890 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:41.199946 24878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:41.192498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.189:40879 (local address 127.0.0.1:42769)
0810 06:44:41.192542 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:41.192544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:41.192652 (+ 108us) server_negotiation.cc:407] Connection header received
0810 06:44:41.192693 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:41.192693 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:41.192703 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:41.192763 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:41.193435 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:41.194203 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:41.195258 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:41.195590 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:41.195632 (+ 42us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:41.197116 (+ 1484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:41.197117 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:41.197118 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:41.197125 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:41.198859 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:41.199228 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:41.199229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:41.199230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:41.199288 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:41.199480 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:41.199481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:41.199481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:41.199611 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:41.199717 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:41.199788 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 06:44:41.199850 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:44:41.201918 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 24780
W20260810 06:44:41.216225 24761 connection.cc:535] client connection to 127.0.0.1:42769 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42769): Connection reset by peer (error 104)
2026-08-10T06:44:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1461 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:41 dist-test-slave-bw88 krb5kdc[24918](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:41 dist-test-slave-bw88 krb5kdc[24918](info): set up 2 sockets
Aug 10 06:44:41 dist-test-slave-bw88 krb5kdc[24918](info): commencing operation
krb5kdc: starting...
W20260810 06:44:42.423488 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:42 dist-test-slave-bw88 krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:44:42.548875 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44745
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44745
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:42.634915 24936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:42.635159 24936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:42.635200 24936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:42.636348 24936 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:42.636417 24936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:42.636443 24936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:42.636497 24936 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:42.636526 24936 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:42.638087 24936 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44745
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:42.638372 24936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:42.638607 24936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:42.643735 24952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:42.643777 24948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:42.643777 24946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:42.643813 24936 server_base.cc:1034] running on GCE node
I20260810 06:44:42.644187 24936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:42.644471 24936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:42.645609 24936 hybrid_clock.cc:648] HybridClock initialized: now 1786344282645596 us; error 28 us; skew 500 ppm
Aug 10 06:44:42 dist-test-slave-bw88 krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344282, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:42.647995 24936 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:44:42.648404 24936 webserver.cc:460] Webserver started at http://127.0.0.1:41325/ using document root <none> and password file <none>
I20260810 06:44:42.648626 24936 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:42.648671 24936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:42.648833 24936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:42.649916 24936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "c2f23793113a4c8f918fe17d5143c0e3"
format_stamp: "Formatted at 2026-08-10 06:44:42 on dist-test-slave-bw88"
server_key: "5741ef10116d91749c07413473496444"
server_key_iv: "1a066d0e18b26e261237e2ea14641a65"
server_key_version: "encryptionkey@0"
I20260810 06:44:42.650262 24936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "c2f23793113a4c8f918fe17d5143c0e3"
format_stamp: "Formatted at 2026-08-10 06:44:42 on dist-test-slave-bw88"
server_key: "5741ef10116d91749c07413473496444"
server_key_iv: "1a066d0e18b26e261237e2ea14641a65"
server_key_version: "encryptionkey@0"
I20260810 06:44:42.651604 24936 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:44:42.652321 24959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:42.652521 24936 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:42.652622 24936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "c2f23793113a4c8f918fe17d5143c0e3"
format_stamp: "Formatted at 2026-08-10 06:44:42 on dist-test-slave-bw88"
server_key: "5741ef10116d91749c07413473496444"
server_key_iv: "1a066d0e18b26e261237e2ea14641a65"
server_key_version: "encryptionkey@0"
I20260810 06:44:42.652696 24936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:42.664605 24936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:42.666967 24936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:42.667125 24936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:42.671206 24936 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44745
I20260810 06:44:42.671243 25034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44745 every 8 connection(s)
I20260810 06:44:42.671615 24936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:42.672472 25035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:42.673951 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 24936
I20260810 06:44:42.674096 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:42.674315 27814 external_mini_cluster.cc:1428] Setting key 7d6bc53a3b47bb5eb62d6b1e59634e6e
I20260810 06:44:42.675411 25035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3: Bootstrap starting.
I20260810 06:44:42.676182 25035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:42.676492 25035 log.cc:824] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:42.677317 25035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3: No bootstrap required, opened a new log
I20260810 06:44:42.679692 25035 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f23793113a4c8f918fe17d5143c0e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44745 } }
I20260810 06:44:42.679845 25035 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:42.679867 25035 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2f23793113a4c8f918fe17d5143c0e3, State: Initialized, Role: FOLLOWER
I20260810 06:44:42.679953 25038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:42.674846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.189:52853 (local address 127.0.0.1:44745)
0810 06:44:42.675030 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:42.675039 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:42.675074 (+ 35us) server_negotiation.cc:407] Connection header received
0810 06:44:42.675533 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:42.675541 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:42.675609 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:42.675722 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:42.675989 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:42.676986 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:42.678121 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:42.678514 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:42.678594 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:42.679276 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:42.679280 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:42.679280 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:42.679429 (+ 149us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:42.679457 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:42.679467 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:42.679530 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:42.679647 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 06:44:42.679692 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":101,"threads_started":1}
I20260810 06:44:42.680037 25035 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f23793113a4c8f918fe17d5143c0e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44745 } }
I20260810 06:44:42.680135 25035 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:42.680163 25035 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:42.680209 25035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:42.680806 25035 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f23793113a4c8f918fe17d5143c0e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44745 } }
I20260810 06:44:42.680917 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:42.680931 25035 leader_election.cc:302] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2f23793113a4c8f918fe17d5143c0e3; no voters:
I20260810 06:44:42.681155 25035 leader_election.cc:288] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:42.681193 25044 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:42.681315 25044 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [term 1 LEADER]: Becoming Leader. State: Replica: c2f23793113a4c8f918fe17d5143c0e3, State: Running, Role: LEADER
I20260810 06:44:42.681448 25035 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:42.681512 25044 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f23793113a4c8f918fe17d5143c0e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44745 } }
I20260810 06:44:42.681917 25044 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2f23793113a4c8f918fe17d5143c0e3. Latest consensus state: current_term: 1 leader_uuid: "c2f23793113a4c8f918fe17d5143c0e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f23793113a4c8f918fe17d5143c0e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44745 } } }
I20260810 06:44:42.681928 25046 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2f23793113a4c8f918fe17d5143c0e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2f23793113a4c8f918fe17d5143c0e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44745 } } }
I20260810 06:44:42.682098 25046 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:42.682305 25044 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:42.682713 25063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:42.683333 25063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:42.685603 25063 catalog_manager.cc:1347] Generated new cluster ID: be196cdf04a34b96b46ae690c7a0999b
I20260810 06:44:42.685653 25063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:42.686637 25038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:42.682498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.189:59031 (local address 127.0.0.1:44745)
0810 06:44:42.682532 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:42.682534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:42.683306 (+ 772us) server_negotiation.cc:407] Connection header received
0810 06:44:42.683380 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:42.683381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:42.683393 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:42.683472 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:42.683629 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:42.684210 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:42.685250 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:42.685585 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:42.685662 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:42.686398 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:42.686399 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:42.686400 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:42.686405 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:42.686420 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:42.686425 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:42.686481 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:42.686554 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 06:44:42.686563 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:44:42.719779 25063 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:42.720355 25063 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:42.729553 25063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2f23793113a4c8f918fe17d5143c0e3: Generated new TSK 0
I20260810 06:44:42.729758 25063 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:42.734570 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 24936
W20260810 06:44:42.744966 24913 connection.cc:535] client connection to 127.0.0.1:44745 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44745): Connection reset by peer (error 104)
2026-08-10T06:44:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1528 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:42 dist-test-slave-bw88 krb5kdc[25080](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:42 dist-test-slave-bw88 krb5kdc[25080](info): set up 2 sockets
Aug 10 06:44:42 dist-test-slave-bw88 krb5kdc[25080](info): commencing operation
krb5kdc: starting...
W20260810 06:44:43.923179 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:44 dist-test-slave-bw88 krb5kdc[25080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:44:44.052353 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33697
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:44.137089 25097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:44.137337 25097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:44.137419 25097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:44.138573 25097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:44.138641 25097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:44.138667 25097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:44.138697 25097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:44.138726 25097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:44.140198 25097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33697
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:44.140461 25097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:44.140687 25097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:44.145638 25106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:44.145751 25097 server_base.cc:1034] running on GCE node
W20260810 06:44:44.145668 25111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:44.145891 25105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:44.146171 25097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:44.146467 25097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:44.147630 25097 hybrid_clock.cc:648] HybridClock initialized: now 1786344284147604 us; error 45 us; skew 500 ppm
Aug 10 06:44:44 dist-test-slave-bw88 krb5kdc[25080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344284, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:44.150241 25097 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:44:44.150673 25097 webserver.cc:460] Webserver started at http://127.0.0.1:46053/ using document root <none> and password file <none>
I20260810 06:44:44.150899 25097 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:44.150966 25097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:44.151122 25097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:44.152164 25097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "a1178fc5262c41319743e3494a117ecd"
format_stamp: "Formatted at 2026-08-10 06:44:44 on dist-test-slave-bw88"
server_key: "400adb2fd23b049966140c172ec92b20"
server_key_iv: "8509561dfadbb5e27ac9199cd12e6d4c"
server_key_version: "encryptionkey@0"
I20260810 06:44:44.152532 25097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "a1178fc5262c41319743e3494a117ecd"
format_stamp: "Formatted at 2026-08-10 06:44:44 on dist-test-slave-bw88"
server_key: "400adb2fd23b049966140c172ec92b20"
server_key_iv: "8509561dfadbb5e27ac9199cd12e6d4c"
server_key_version: "encryptionkey@0"
I20260810 06:44:44.153963 25097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:44:44.154695 25119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:44.154862 25097 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:44.154973 25097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "a1178fc5262c41319743e3494a117ecd"
format_stamp: "Formatted at 2026-08-10 06:44:44 on dist-test-slave-bw88"
server_key: "400adb2fd23b049966140c172ec92b20"
server_key_iv: "8509561dfadbb5e27ac9199cd12e6d4c"
server_key_version: "encryptionkey@0"
I20260810 06:44:44.155048 25097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:44.158463 25097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:44.160383 25097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:44.160571 25097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:44.164637 25097 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33697
I20260810 06:44:44.164670 25192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33697 every 8 connection(s)
I20260810 06:44:44.164999 25097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:44.166072 25194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:44.167747 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 25097
I20260810 06:44:44.167876 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:44.168081 27814 external_mini_cluster.cc:1428] Setting key 6a20f105f8112eb34c3e263d04e3010a
I20260810 06:44:44.168794 25194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd: Bootstrap starting.
I20260810 06:44:44.169533 25194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:44.169881 25194 log.cc:824] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:44.170629 25194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd: No bootstrap required, opened a new log
I20260810 06:44:44.170832 25198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:44.168634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.189:33185 (local address 127.0.0.1:33697)
0810 06:44:44.168831 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:44.168840 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:44.168872 (+ 32us) server_negotiation.cc:407] Connection header received
0810 06:44:44.169521 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:44.169530 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:44.169577 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:44.169754 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:44.170387 (+ 633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:44.170391 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:44.170391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:44.170396 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:44.170446 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:44.170456 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:44.170556 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:44.170603 (+ 47us) server_negotiation.cc:299] Negotiation successful
0810 06:44:44.170647 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":77,"threads_started":1}
I20260810 06:44:44.171944 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:44.173270 25194 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1178fc5262c41319743e3494a117ecd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } }
I20260810 06:44:44.173484 25194 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:44.173588 25194 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1178fc5262c41319743e3494a117ecd, State: Initialized, Role: FOLLOWER
I20260810 06:44:44.173719 25194 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1178fc5262c41319743e3494a117ecd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } }
I20260810 06:44:44.173832 25194 raft_consensus.cc:388] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:44.173878 25194 raft_consensus.cc:482] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:44.173930 25194 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:44.174692 25198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:44.173606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.189:42461 (local address 127.0.0.1:33697)
0810 06:44:44.173642 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:44.173644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:44.173800 (+ 156us) server_negotiation.cc:407] Connection header received
0810 06:44:44.173893 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:44.173894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:44.173899 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:44.173952 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:44.174522 (+ 570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:44.174523 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:44.174524 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:44.174527 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:44.174539 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:44.174543 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:44.174587 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:44.174643 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 06:44:44.174653 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:44:44.174710 25194 raft_consensus.cc:504] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1178fc5262c41319743e3494a117ecd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } }
I20260810 06:44:44.174821 25194 leader_election.cc:302] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1178fc5262c41319743e3494a117ecd; no voters:
I20260810 06:44:44.174985 25194 leader_election.cc:288] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:44.175016 25210 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:44.175187 25210 raft_consensus.cc:686] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [term 1 LEADER]: Becoming Leader. State: Replica: a1178fc5262c41319743e3494a117ecd, State: Running, Role: LEADER
I20260810 06:44:44.175242 25194 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:44.175309 25210 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1178fc5262c41319743e3494a117ecd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } }
I20260810 06:44:44.175655 25210 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1178fc5262c41319743e3494a117ecd. Latest consensus state: current_term: 1 leader_uuid: "a1178fc5262c41319743e3494a117ecd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1178fc5262c41319743e3494a117ecd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } } }
I20260810 06:44:44.175689 25211 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1178fc5262c41319743e3494a117ecd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1178fc5262c41319743e3494a117ecd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } } }
I20260810 06:44:44.175786 25210 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:44.176146 25224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:44.175889 25211 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:44.176715 25224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:44.178397 25224 catalog_manager.cc:1347] Generated new cluster ID: bf97dd94583c4ad690f2e38ad5e6cb43
I20260810 06:44:44.178467 25224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:44.184283 25224 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:44.184446 25224 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:44.195947 25224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a1178fc5262c41319743e3494a117ecd: Generated new TSK 0
I20260810 06:44:44.196148 25224 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:44.200559 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 25097
2026-08-10T06:44:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1468 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:44 dist-test-slave-bw88 krb5kdc[25241](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:44 dist-test-slave-bw88 krb5kdc[25241](info): set up 2 sockets
Aug 10 06:44:44 dist-test-slave-bw88 krb5kdc[25241](info): commencing operation
krb5kdc: starting...
W20260810 06:44:45.407056 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:45 dist-test-slave-bw88 krb5kdc[25241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:44:45.530423 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:33363
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:33363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:45.612535 25260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:45.612732 25260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:45.612754 25260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:45.613858 25260 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:45.613894 25260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:45.613909 25260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:45.613921 25260 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:45.613933 25260 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:45.615329 25260 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:33363
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:33363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:45.615522 25260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:45.615692 25260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:45.620541 25266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:45.620525 25267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:45.620525 25269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:45.620766 25260 server_base.cc:1034] running on GCE node
I20260810 06:44:45.621016 25260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:45.621390 25260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:45.622545 25260 hybrid_clock.cc:648] HybridClock initialized: now 1786344285622522 us; error 35 us; skew 500 ppm
Aug 10 06:44:45 dist-test-slave-bw88 krb5kdc[25241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344285, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:45.628504 25260 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:44:45.628990 25260 webserver.cc:460] Webserver started at http://127.27.41.190:39349/ using document root <none> and password file <none>
I20260810 06:44:45.629230 25260 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:45.629299 25260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:45.629473 25260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:45.630556 25260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "970eed751fbf44e893d21e452e61ed8c"
format_stamp: "Formatted at 2026-08-10 06:44:45 on dist-test-slave-bw88"
server_key: "d0e3c247c934e1e833651d686a641cb1"
server_key_iv: "c0a220b659b5d7f1b89244d5b497802b"
server_key_version: "encryptionkey@0"
I20260810 06:44:45.630946 25260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "970eed751fbf44e893d21e452e61ed8c"
format_stamp: "Formatted at 2026-08-10 06:44:45 on dist-test-slave-bw88"
server_key: "d0e3c247c934e1e833651d686a641cb1"
server_key_iv: "c0a220b659b5d7f1b89244d5b497802b"
server_key_version: "encryptionkey@0"
I20260810 06:44:45.632220 25260 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 06:44:45.632962 25277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:45.633136 25260 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:45.633242 25260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "970eed751fbf44e893d21e452e61ed8c"
format_stamp: "Formatted at 2026-08-10 06:44:45 on dist-test-slave-bw88"
server_key: "d0e3c247c934e1e833651d686a641cb1"
server_key_iv: "c0a220b659b5d7f1b89244d5b497802b"
server_key_version: "encryptionkey@0"
I20260810 06:44:45.633325 25260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:45.647900 25260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:45.650136 25260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:45.650291 25260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:45.654475 25260 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:33363
I20260810 06:44:45.654524 25352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:33363 every 8 connection(s)
I20260810 06:44:45.654886 25260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:45.655732 25353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:45.658008 25353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c: Bootstrap starting.
I20260810 06:44:45.658605 25353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:45.658882 25353 log.cc:824] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:45.659588 25353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c: No bootstrap required, opened a new log
I20260810 06:44:45.661135 25353 raft_consensus.cc:348] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970eed751fbf44e893d21e452e61ed8c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33363 } }
I20260810 06:44:45.661286 25353 raft_consensus.cc:374] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:45.661309 25353 raft_consensus.cc:729] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 970eed751fbf44e893d21e452e61ed8c, State: Initialized, Role: FOLLOWER
I20260810 06:44:45.661491 25353 consensus_queue.cc:260] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970eed751fbf44e893d21e452e61ed8c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33363 } }
I20260810 06:44:45.661563 25353 raft_consensus.cc:388] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:45.661585 25353 raft_consensus.cc:482] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:45.661651 25353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:45.662497 25353 raft_consensus.cc:504] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970eed751fbf44e893d21e452e61ed8c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33363 } }
I20260810 06:44:45.662616 25353 leader_election.cc:302] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 970eed751fbf44e893d21e452e61ed8c; no voters:
I20260810 06:44:45.662817 25353 leader_election.cc:288] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:45.662873 25356 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:45.663029 25356 raft_consensus.cc:686] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [term 1 LEADER]: Becoming Leader. State: Replica: 970eed751fbf44e893d21e452e61ed8c, State: Running, Role: LEADER
I20260810 06:44:45.663061 25353 sys_catalog.cc:564] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:45.663178 25356 consensus_queue.cc:237] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970eed751fbf44e893d21e452e61ed8c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33363 } }
I20260810 06:44:45.663534 25357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "970eed751fbf44e893d21e452e61ed8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970eed751fbf44e893d21e452e61ed8c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33363 } } }
I20260810 06:44:45.663661 25357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:45.663537 25358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 970eed751fbf44e893d21e452e61ed8c. Latest consensus state: current_term: 1 leader_uuid: "970eed751fbf44e893d21e452e61ed8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970eed751fbf44e893d21e452e61ed8c" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 33363 } } }
I20260810 06:44:45.663801 25358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:45.664137 25364 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:45.664674 25364 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:45.665089 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 25260
I20260810 06:44:45.665242 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:45.665477 27814 external_mini_cluster.cc:1428] Setting key fac9e86de31ecbc2194f3742404e369b
I20260810 06:44:45.666303 25364 catalog_manager.cc:1347] Generated new cluster ID: 760dcf2617734ac383858b355e745338
I20260810 06:44:45.666360 25364 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:44:45 dist-test-slave-bw88 krb5kdc[25241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:45.675493 25381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:45.665944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34151 (local address 127.27.41.190:33363)
0810 06:44:45.666579 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:45.666586 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:45.666612 (+ 26us) server_negotiation.cc:407] Connection header received
0810 06:44:45.666698 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:45.666703 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:45.666743 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:45.666868 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:45.667516 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:45.668440 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:45.669226 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:45.669747 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:45.669865 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:45.672197 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:45.672202 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:45.672202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:45.672214 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:45.673902 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:45.674320 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:45.674327 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:45.674328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:45.674427 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:45.674673 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:45.674674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:45.674674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:45.674910 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:45.675099 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:45.675185 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 06:44:45.675288 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":59,"threads_started":1}
I20260810 06:44:45.676569 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:45.687553 25381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:45.677979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55825 (local address 127.27.41.190:33363)
0810 06:44:45.678016 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:45.678018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:45.681532 (+ 3514us) server_negotiation.cc:407] Connection header received
0810 06:44:45.681613 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:45.681614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:45.681624 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:45.681680 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:45.682204 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:45.682700 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:45.683410 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:45.683630 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:45.683706 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:45.684945 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:45.684946 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:45.684947 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:45.684954 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:45.686363 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:45.686739 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:45.686740 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:45.686741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:45.686803 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:45.687045 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:45.687046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:45.687046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:45.687158 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:45.687266 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:45.687392 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 06:44:45.687454 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 06:44:45.697929 25364 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:45.698626 25364 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:45.710820 25364 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 970eed751fbf44e893d21e452e61ed8c: Generated new TSK 0
I20260810 06:44:45.711004 25364 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:45.717159 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 25260
W20260810 06:44:45.727916 25238 connection.cc:535] client connection to 127.27.41.190:33363 recv error: Network error: failed to read from TLS socket (remote: 127.27.41.190:33363): Connection reset by peer (error 104)
2026-08-10T06:44:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1513 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:45 dist-test-slave-bw88 krb5kdc[25391](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:45 dist-test-slave-bw88 krb5kdc[25391](info): set up 2 sockets
Aug 10 06:44:45 dist-test-slave-bw88 krb5kdc[25391](info): commencing operation
krb5kdc: starting...
W20260810 06:44:46.918033 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:46 dist-test-slave-bw88 krb5kdc[25391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:44:47.035778 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:39943
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:43193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:39943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:47.122437 25413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:47.122684 25413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:47.122725 25413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:47.123930 25413 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:47.123999 25413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:47.124025 25413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:47.124058 25413 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:47.124083 25413 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:47.125684 25413 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:43193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:39943
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:39943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:47.125974 25413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:47.126204 25413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:47.131557 25426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:47.131605 25423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:47.131541 25421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:47.131919 25413 server_base.cc:1034] running on GCE node
I20260810 06:44:47.132229 25413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:47.132485 25413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:47.133649 25413 hybrid_clock.cc:648] HybridClock initialized: now 1786344287133634 us; error 28 us; skew 500 ppm
Aug 10 06:44:47 dist-test-slave-bw88 krb5kdc[25391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344287, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:47.136094 25413 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:44:47.136521 25413 webserver.cc:460] Webserver started at http://127.27.41.190:46259/ using document root <none> and password file <none>
I20260810 06:44:47.136792 25413 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:47.136861 25413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:47.137004 25413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:47.138126 25413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "c46a023edd3c49279a1a61b00b37e55a"
format_stamp: "Formatted at 2026-08-10 06:44:47 on dist-test-slave-bw88"
server_key: "69256c2cb3a9fc343f5d7907c35e19e1"
server_key_iv: "6ec8dee291bc61191a05e667bf614393"
server_key_version: "encryptionkey@0"
I20260810 06:44:47.138495 25413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "c46a023edd3c49279a1a61b00b37e55a"
format_stamp: "Formatted at 2026-08-10 06:44:47 on dist-test-slave-bw88"
server_key: "69256c2cb3a9fc343f5d7907c35e19e1"
server_key_iv: "6ec8dee291bc61191a05e667bf614393"
server_key_version: "encryptionkey@0"
I20260810 06:44:47.139781 25413 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:44:47.140686 25437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:47.140882 25413 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:44:47.140990 25413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "c46a023edd3c49279a1a61b00b37e55a"
format_stamp: "Formatted at 2026-08-10 06:44:47 on dist-test-slave-bw88"
server_key: "69256c2cb3a9fc343f5d7907c35e19e1"
server_key_iv: "6ec8dee291bc61191a05e667bf614393"
server_key_version: "encryptionkey@0"
I20260810 06:44:47.141072 25413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:47.152360 25413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:47.154148 25413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:47.154301 25413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:47.158280 25413 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:39943
I20260810 06:44:47.158313 25503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:39943 every 8 connection(s)
I20260810 06:44:47.158667 25413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:47.159505 25504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:47.161054 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 25413
I20260810 06:44:47.161206 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:47.161464 27814 external_mini_cluster.cc:1428] Setting key 430f46069983d61e1577532de97433cb
I20260810 06:44:47.162249 25504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a: Bootstrap starting.
I20260810 06:44:47.162842 25504 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:47.163200 25504 log.cc:824] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:47.163987 25504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a: No bootstrap required, opened a new log
I20260810 06:44:47.166416 25504 raft_consensus.cc:348] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c46a023edd3c49279a1a61b00b37e55a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39943 } }
I20260810 06:44:47.166646 25504 raft_consensus.cc:374] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:47.166697 25504 raft_consensus.cc:729] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c46a023edd3c49279a1a61b00b37e55a, State: Initialized, Role: FOLLOWER
I20260810 06:44:47.166865 25504 consensus_queue.cc:260] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c46a023edd3c49279a1a61b00b37e55a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39943 } }
I20260810 06:44:47.166955 25504 raft_consensus.cc:388] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:47.167001 25504 raft_consensus.cc:482] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:47.167058 25504 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:47.167429 25509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:47.162000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44555 (local address 127.27.41.190:39943)
0810 06:44:47.162198 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:47.162209 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:47.162240 (+ 31us) server_negotiation.cc:407] Connection header received
0810 06:44:47.162724 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:47.162730 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:47.162811 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:47.162971 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:47.163234 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:47.164395 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:47.165538 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:47.165926 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:47.166008 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:47.166754 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:47.166758 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:47.166758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:47.166981 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:47.167028 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:47.167044 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:47.167142 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:47.167232 (+ 90us) server_negotiation.cc:299] Negotiation successful
0810 06:44:47.167260 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":82,"threads_started":1}
I20260810 06:44:47.167829 25504 raft_consensus.cc:504] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c46a023edd3c49279a1a61b00b37e55a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39943 } }
I20260810 06:44:47.167938 25504 leader_election.cc:302] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c46a023edd3c49279a1a61b00b37e55a; no voters:
I20260810 06:44:47.168120 25504 leader_election.cc:288] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:47.168165 25512 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:47.168407 25512 raft_consensus.cc:686] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [term 1 LEADER]: Becoming Leader. State: Replica: c46a023edd3c49279a1a61b00b37e55a, State: Running, Role: LEADER
I20260810 06:44:47.168509 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:47.168411 25504 sys_catalog.cc:564] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:47.168607 25512 consensus_queue.cc:237] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c46a023edd3c49279a1a61b00b37e55a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39943 } }
I20260810 06:44:47.169811 25514 sys_catalog.cc:455] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c46a023edd3c49279a1a61b00b37e55a. Latest consensus state: current_term: 1 leader_uuid: "c46a023edd3c49279a1a61b00b37e55a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c46a023edd3c49279a1a61b00b37e55a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39943 } } }
I20260810 06:44:47.169909 25514 sys_catalog.cc:458] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:47.170161 25513 sys_catalog.cc:455] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c46a023edd3c49279a1a61b00b37e55a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c46a023edd3c49279a1a61b00b37e55a" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39943 } } }
I20260810 06:44:47.170297 25513 sys_catalog.cc:458] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:47.170478 25537 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:47.171026 25537 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:47.173477 25509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:47.170079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57949 (local address 127.27.41.190:39943)
0810 06:44:47.170124 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:47.170125 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:47.170272 (+ 147us) server_negotiation.cc:407] Connection header received
0810 06:44:47.170363 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:47.170363 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:47.170372 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:47.170429 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:47.170614 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:47.171253 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:47.172334 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:47.172529 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:47.172593 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:47.173223 (+ 630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:47.173224 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:47.173224 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:47.173228 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:47.173240 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:47.173244 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:47.173289 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:47.173397 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 06:44:47.173410 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 06:44:47.173801 25537 catalog_manager.cc:1347] Generated new cluster ID: 8f477b31424d473a9fbf0f5cc5fa2c56
I20260810 06:44:47.173877 25537 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:47.188400 25537 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:47.188889 25537 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:47.193085 25537 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c46a023edd3c49279a1a61b00b37e55a: Generated new TSK 0
I20260810 06:44:47.193254 25537 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:47.195652 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 25413
W20260810 06:44:47.220136 25389 connection.cc:535] client connection to 127.27.41.190:39943 recv error: Network error: failed to read from TLS socket (remote: 127.27.41.190:39943): Connection reset by peer (error 104)
2026-08-10T06:44:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1492 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:47 dist-test-slave-bw88 krb5kdc[25549](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:47 dist-test-slave-bw88 krb5kdc[25549](info): set up 2 sockets
Aug 10 06:44:47 dist-test-slave-bw88 krb5kdc[25549](info): commencing operation
krb5kdc: starting...
W20260810 06:44:48.403210 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:48 dist-test-slave-bw88 krb5kdc[25549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:44:48.528147 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:37853
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:42045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:37853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:48.610095 25566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:48.610332 25566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:48.610368 25566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:48.611465 25566 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:48.611533 25566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:48.611557 25566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:48.611578 25566 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:48.611609 25566 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:48.613058 25566 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:42045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:37853
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:37853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:48.613354 25566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:48.613588 25566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:48.618634 25572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:48.618709 25566 server_base.cc:1034] running on GCE node
W20260810 06:44:48.618716 25573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:48.618634 25576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:48.619062 25566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:48.619299 25566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:48.620455 25566 hybrid_clock.cc:648] HybridClock initialized: now 1786344288620441 us; error 30 us; skew 500 ppm
Aug 10 06:44:48 dist-test-slave-bw88 krb5kdc[25549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344288, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:48.622937 25566 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:44:48.623382 25566 webserver.cc:460] Webserver started at http://127.27.41.190:45099/ using document root <none> and password file <none>
I20260810 06:44:48.623574 25566 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:48.623613 25566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:48.623703 25566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:48.624682 25566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "9d20663eaabb4757b751f5189ed7b180"
format_stamp: "Formatted at 2026-08-10 06:44:48 on dist-test-slave-bw88"
server_key: "22b42e0da2c01811bca7d09ac96e2835"
server_key_iv: "11ed1df91c77614accaed1ed143cf93c"
server_key_version: "encryptionkey@0"
I20260810 06:44:48.624985 25566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "9d20663eaabb4757b751f5189ed7b180"
format_stamp: "Formatted at 2026-08-10 06:44:48 on dist-test-slave-bw88"
server_key: "22b42e0da2c01811bca7d09ac96e2835"
server_key_iv: "11ed1df91c77614accaed1ed143cf93c"
server_key_version: "encryptionkey@0"
I20260810 06:44:48.626332 25566 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:44:48.627038 25584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:48.627224 25566 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:48.627317 25566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "9d20663eaabb4757b751f5189ed7b180"
format_stamp: "Formatted at 2026-08-10 06:44:48 on dist-test-slave-bw88"
server_key: "22b42e0da2c01811bca7d09ac96e2835"
server_key_iv: "11ed1df91c77614accaed1ed143cf93c"
server_key_version: "encryptionkey@0"
I20260810 06:44:48.627393 25566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:48.630726 25566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:48.633085 25566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:48.633252 25566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:48.637187 25566 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:37853
I20260810 06:44:48.637221 25659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:37853 every 8 connection(s)
I20260810 06:44:48.637665 25566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:48.638659 25660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:48.640880 25660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180: Bootstrap starting.
I20260810 06:44:48.641549 25660 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:48.641834 25660 log.cc:824] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:48.642583 25660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180: No bootstrap required, opened a new log
I20260810 06:44:48.642736 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 25566
I20260810 06:44:48.642869 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:48.643064 27814 external_mini_cluster.cc:1428] Setting key 089e042788ea323b968dfab0e344021f
I20260810 06:44:48.644564 25660 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d20663eaabb4757b751f5189ed7b180" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 37853 } }
I20260810 06:44:48.644731 25660 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:48.644796 25660 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d20663eaabb4757b751f5189ed7b180, State: Initialized, Role: FOLLOWER
I20260810 06:44:48.645188 25660 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d20663eaabb4757b751f5189ed7b180" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 37853 } }
I20260810 06:44:48.645305 25660 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:48.645376 25660 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:48.645452 25660 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:48.645967 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:48.643556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44053 (local address 127.27.41.190:37853)
0810 06:44:48.643739 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:48.643749 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:48.643780 (+ 31us) server_negotiation.cc:407] Connection header received
0810 06:44:48.644550 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:48.644556 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:48.644581 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:48.644725 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:48.645272 (+ 547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:48.645276 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:48.645276 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:48.645280 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:48.645382 (+ 102us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:48.645399 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:48.645461 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:48.645580 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 06:44:48.645623 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
I20260810 06:44:48.646135 25660 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d20663eaabb4757b751f5189ed7b180" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 37853 } }
I20260810 06:44:48.646241 25660 leader_election.cc:302] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d20663eaabb4757b751f5189ed7b180; no voters:
I20260810 06:44:48.646441 25660 leader_election.cc:288] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:48.646467 25668 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:48.646628 25668 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [term 1 LEADER]: Becoming Leader. State: Replica: 9d20663eaabb4757b751f5189ed7b180, State: Running, Role: LEADER
I20260810 06:44:48.646739 25660 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:48.646751 25668 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d20663eaabb4757b751f5189ed7b180" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 37853 } }
I20260810 06:44:48.646893 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:48.647267 25669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d20663eaabb4757b751f5189ed7b180. Latest consensus state: current_term: 1 leader_uuid: "9d20663eaabb4757b751f5189ed7b180" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d20663eaabb4757b751f5189ed7b180" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 37853 } } }
I20260810 06:44:48.647346 25669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:48.647504 25671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d20663eaabb4757b751f5189ed7b180" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d20663eaabb4757b751f5189ed7b180" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 37853 } } }
I20260810 06:44:48.647593 25671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:48.647984 25680 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:48.648501 25680 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:48.649791 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:48.648681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52349 (local address 127.27.41.190:37853)
0810 06:44:48.648715 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:48.648717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:48.648837 (+ 120us) server_negotiation.cc:407] Connection header received
0810 06:44:48.648859 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:48.648860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:48.648865 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:48.648907 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:48.649576 (+ 669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:48.649577 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:48.649577 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:48.649581 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:48.649595 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:48.649599 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:48.649657 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:48.649713 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 06:44:48.649728 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 06:44:48.650599 25680 catalog_manager.cc:1347] Generated new cluster ID: edb50cd0c4e6440396219a545960bc3a
I20260810 06:44:48.650656 25680 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:48.659694 25680 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:48.659879 25680 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:48.666258 25680 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d20663eaabb4757b751f5189ed7b180: Generated new TSK 0
I20260810 06:44:48.666453 25680 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:48.672679 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 25566
2026-08-10T06:44:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1462 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:48 dist-test-slave-bw88 krb5kdc[25706](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:48 dist-test-slave-bw88 krb5kdc[25706](info): set up 2 sockets
Aug 10 06:44:48 dist-test-slave-bw88 krb5kdc[25706](info): commencing operation
krb5kdc: starting...
W20260810 06:44:49.870393 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:49 dist-test-slave-bw88 krb5kdc[25706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:44:49.991971 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:44509
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:39167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:44509
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:50.074178 25725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:50.074378 25725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:50.074401 25725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:50.075464 25725 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:50.075498 25725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:50.075512 25725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:50.075526 25725 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:50.075538 25725 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:50.076934 25725 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:39167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:44509
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:44509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:50.077124 25725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:50.077291 25725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:50.082432 25734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:50.082430 25731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:50.082499 25732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:50.082623 25725 server_base.cc:1034] running on GCE node
I20260810 06:44:50.082876 25725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:50.083145 25725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:50.084285 25725 hybrid_clock.cc:648] HybridClock initialized: now 1786344290084273 us; error 29 us; skew 500 ppm
Aug 10 06:44:50 dist-test-slave-bw88 krb5kdc[25706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344290, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:50.086845 25725 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:44:50.087213 25725 webserver.cc:460] Webserver started at http://127.27.41.190:43947/ using document root <none> and password file <none>
I20260810 06:44:50.087411 25725 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:50.087450 25725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:50.087543 25725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:50.088492 25725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "66e68bd13cf04c4f87ab5f18e9618085"
format_stamp: "Formatted at 2026-08-10 06:44:50 on dist-test-slave-bw88"
server_key: "bbc828f09625935b625d45172b4192f3"
server_key_iv: "be240610753bac19a2a1ff58fff0bfb7"
server_key_version: "encryptionkey@0"
I20260810 06:44:50.088802 25725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "66e68bd13cf04c4f87ab5f18e9618085"
format_stamp: "Formatted at 2026-08-10 06:44:50 on dist-test-slave-bw88"
server_key: "bbc828f09625935b625d45172b4192f3"
server_key_iv: "be240610753bac19a2a1ff58fff0bfb7"
server_key_version: "encryptionkey@0"
I20260810 06:44:50.090103 25725 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:44:50.090761 25742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:50.090962 25725 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:50.091071 25725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "66e68bd13cf04c4f87ab5f18e9618085"
format_stamp: "Formatted at 2026-08-10 06:44:50 on dist-test-slave-bw88"
server_key: "bbc828f09625935b625d45172b4192f3"
server_key_iv: "be240610753bac19a2a1ff58fff0bfb7"
server_key_version: "encryptionkey@0"
I20260810 06:44:50.091145 25725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:50.112241 25725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:50.114192 25725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:50.114362 25725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:50.118598 25725 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:44509
I20260810 06:44:50.118654 25821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:44509 every 8 connection(s)
I20260810 06:44:50.119011 25725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:50.119892 25823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:50.122364 25823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085: Bootstrap starting.
I20260810 06:44:50.123003 25823 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:50.123297 25823 log.cc:824] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:50.124042 25823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085: No bootstrap required, opened a new log
I20260810 06:44:50.125721 25823 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e68bd13cf04c4f87ab5f18e9618085" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44509 } }
I20260810 06:44:50.125866 25823 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:50.125918 25823 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e68bd13cf04c4f87ab5f18e9618085, State: Initialized, Role: FOLLOWER
I20260810 06:44:50.126111 25823 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e68bd13cf04c4f87ab5f18e9618085" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44509 } }
I20260810 06:44:50.126192 25823 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:50.126238 25823 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:50.126289 25823 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:50.126922 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 25725
I20260810 06:44:50.127085 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:50.127286 27814 external_mini_cluster.cc:1428] Setting key 91e202dabc0fb97148776f3d016bb8d9
I20260810 06:44:50.127388 25823 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e68bd13cf04c4f87ab5f18e9618085" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44509 } }
I20260810 06:44:50.127524 25823 leader_election.cc:302] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66e68bd13cf04c4f87ab5f18e9618085; no voters:
I20260810 06:44:50.127723 25823 leader_election.cc:288] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:50.127831 25828 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:50.128014 25823 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:50.128039 25828 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [term 1 LEADER]: Becoming Leader. State: Replica: 66e68bd13cf04c4f87ab5f18e9618085, State: Running, Role: LEADER
I20260810 06:44:50.129527 25828 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e68bd13cf04c4f87ab5f18e9618085" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44509 } }
I20260810 06:44:50.130187 25832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66e68bd13cf04c4f87ab5f18e9618085" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e68bd13cf04c4f87ab5f18e9618085" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44509 } } }
I20260810 06:44:50.130187 25830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66e68bd13cf04c4f87ab5f18e9618085. Latest consensus state: current_term: 1 leader_uuid: "66e68bd13cf04c4f87ab5f18e9618085" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e68bd13cf04c4f87ab5f18e9618085" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 44509 } } }
I20260810 06:44:50.130298 25832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:50.130303 25830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:50.130570 25849 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:50.131220 25849 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:50.132910 25849 catalog_manager.cc:1347] Generated new cluster ID: 936a4f65c71240ec8f6de942fd11b5db
I20260810 06:44:50.132968 25849 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:44:50 dist-test-slave-bw88 krb5kdc[25706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:50.139014 25831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:50.127789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55883 (local address 127.27.41.190:44509)
0810 06:44:50.128129 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:50.128139 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:50.128174 (+ 35us) server_negotiation.cc:407] Connection header received
0810 06:44:50.128281 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:50.128287 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:50.128328 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:50.128462 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:50.129157 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:50.130733 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:50.131531 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:50.132002 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:50.132136 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:50.135056 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:50.135061 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:50.135061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:50.135074 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:50.137052 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:50.137450 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:50.137453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:50.137453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:50.137565 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:50.137760 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:50.137760 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:50.137761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:50.138036 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:50.138592 (+ 556us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:50.138659 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 06:44:50.138788 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":67,"threads_started":1}
I20260810 06:44:50.140000 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:50.148728 25831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:50.141618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59079 (local address 127.27.41.190:44509)
0810 06:44:50.141655 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:50.141657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:50.141792 (+ 135us) server_negotiation.cc:407] Connection header received
0810 06:44:50.141849 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:50.141849 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:50.141871 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:50.141916 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:50.142546 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:50.143257 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:50.144263 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:50.144542 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:50.144597 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:50.146031 (+ 1434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:50.146033 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:50.146033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:50.146039 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:50.147535 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:50.147927 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:50.147928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:50.147929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:50.148006 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:50.148201 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:50.148202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:50.148202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:50.148315 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:50.148401 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:50.148548 (+ 147us) server_negotiation.cc:299] Negotiation successful
0810 06:44:50.148643 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:44:50.150360 25849 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:50.151054 25849 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:50.155782 25849 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66e68bd13cf04c4f87ab5f18e9618085: Generated new TSK 0
I20260810 06:44:50.155970 25849 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:50.163033 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 25725
2026-08-10T06:44:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1493 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:50 dist-test-slave-bw88 krb5kdc[25866](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:50 dist-test-slave-bw88 krb5kdc[25866](info): set up 2 sockets
Aug 10 06:44:50 dist-test-slave-bw88 krb5kdc[25866](info): commencing operation
krb5kdc: starting...
W20260810 06:44:51.372956 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:51 dist-test-slave-bw88 krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344291, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:44:51.494196 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:34601
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:38689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:34601
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:51.576694 25882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:51.576949 25882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:51.576988 25882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:51.578182 25882 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:51.578253 25882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:51.578276 25882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:51.578296 25882 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:51.578327 25882 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:51.579860 25882 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:38689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:34601
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:34601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:51.580143 25882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:51.580377 25882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:51.585325 25895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:51.585414 25888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:51.585325 25889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:51.585614 25882 server_base.cc:1034] running on GCE node
I20260810 06:44:51.585826 25882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:51.586117 25882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:51.587252 25882 hybrid_clock.cc:648] HybridClock initialized: now 1786344291587239 us; error 29 us; skew 500 ppm
Aug 10 06:44:51 dist-test-slave-bw88 krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344291, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:51.592269 25882 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:44:51.592698 25882 webserver.cc:460] Webserver started at http://127.27.41.190:44831/ using document root <none> and password file <none>
I20260810 06:44:51.592967 25882 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:51.593011 25882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:51.593176 25882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:51.594310 25882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "0b0e2debb4274df6bed0fb5f4ebe3bd5"
format_stamp: "Formatted at 2026-08-10 06:44:51 on dist-test-slave-bw88"
server_key: "9607f74e4e8b81a90ac4396bbcf466e7"
server_key_iv: "94ce26352991cd1ff6a578f7acce582c"
server_key_version: "encryptionkey@0"
I20260810 06:44:51.594671 25882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "0b0e2debb4274df6bed0fb5f4ebe3bd5"
format_stamp: "Formatted at 2026-08-10 06:44:51 on dist-test-slave-bw88"
server_key: "9607f74e4e8b81a90ac4396bbcf466e7"
server_key_iv: "94ce26352991cd1ff6a578f7acce582c"
server_key_version: "encryptionkey@0"
I20260810 06:44:51.596125 25882 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:44:51.596846 25903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:51.597011 25882 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:51.597126 25882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "0b0e2debb4274df6bed0fb5f4ebe3bd5"
format_stamp: "Formatted at 2026-08-10 06:44:51 on dist-test-slave-bw88"
server_key: "9607f74e4e8b81a90ac4396bbcf466e7"
server_key_iv: "94ce26352991cd1ff6a578f7acce582c"
server_key_version: "encryptionkey@0"
I20260810 06:44:51.597199 25882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:51.608314 25882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:51.610221 25882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:51.610368 25882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:51.614339 25882 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:34601
I20260810 06:44:51.614389 25972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:34601 every 8 connection(s)
I20260810 06:44:51.614686 25882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:51.615551 25973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:51.617890 25973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5: Bootstrap starting.
I20260810 06:44:51.618490 25973 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:51.618779 25973 log.cc:824] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:51.618896 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 25882
I20260810 06:44:51.619027 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:51.619218 27814 external_mini_cluster.cc:1428] Setting key bc2ddd6464a1ab8320ee134196de4ccd
I20260810 06:44:51.619568 25973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5: No bootstrap required, opened a new log
I20260810 06:44:51.621476 25973 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0e2debb4274df6bed0fb5f4ebe3bd5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34601 } }
I20260810 06:44:51.621620 25973 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:51.621644 25973 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0e2debb4274df6bed0fb5f4ebe3bd5, State: Initialized, Role: FOLLOWER
I20260810 06:44:51.621790 25973 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0e2debb4274df6bed0fb5f4ebe3bd5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34601 } }
I20260810 06:44:51.621852 25973 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:51.621888 25973 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:51.621938 25973 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:51.622499 25973 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0e2debb4274df6bed0fb5f4ebe3bd5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34601 } }
I20260810 06:44:51.622594 25973 leader_election.cc:302] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b0e2debb4274df6bed0fb5f4ebe3bd5; no voters:
I20260810 06:44:51.622789 25973 leader_election.cc:288] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:51.622812 25979 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:51.622934 25979 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [term 1 LEADER]: Becoming Leader. State: Replica: 0b0e2debb4274df6bed0fb5f4ebe3bd5, State: Running, Role: LEADER
I20260810 06:44:51.623064 25973 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:51.623082 25979 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0e2debb4274df6bed0fb5f4ebe3bd5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34601 } }
I20260810 06:44:51.623668 25983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b0e2debb4274df6bed0fb5f4ebe3bd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0e2debb4274df6bed0fb5f4ebe3bd5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34601 } } }
I20260810 06:44:51.623768 25983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:51.623979 25980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b0e2debb4274df6bed0fb5f4ebe3bd5. Latest consensus state: current_term: 1 leader_uuid: "0b0e2debb4274df6bed0fb5f4ebe3bd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0e2debb4274df6bed0fb5f4ebe3bd5" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 34601 } } }
I20260810 06:44:51.624066 25980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:51.624230 25988 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:51.624759 25988 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:51.626207 25988 catalog_manager.cc:1347] Generated new cluster ID: 43e3196dcfe74c3cac3d9bda19bfaa9a
I20260810 06:44:51.626263 25988 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:51.630499 25978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:51.619704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44299 (local address 127.27.41.190:34601)
0810 06:44:51.619913 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:51.619923 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:51.619956 (+ 33us) server_negotiation.cc:407] Connection header received
0810 06:44:51.620766 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:51.620774 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:51.620820 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:51.620961 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:51.621205 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:51.622585 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:51.623610 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:51.624239 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:51.624328 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:51.629856 (+ 5528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:51.629859 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:51.629860 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:51.630033 (+ 173us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:51.630063 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:51.630073 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:51.630143 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:51.630219 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 06:44:51.630284 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":99,"threads_started":1}
I20260810 06:44:51.631403 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:51.636103 25978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:51.632831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37071 (local address 127.27.41.190:34601)
0810 06:44:51.632868 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:51.632870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:51.633493 (+ 623us) server_negotiation.cc:407] Connection header received
0810 06:44:51.633564 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:51.633565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:51.633576 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:51.633626 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:51.633771 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:51.634250 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:51.634954 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:51.635165 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:51.635237 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:51.635860 (+ 623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:51.635861 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:51.635861 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:51.635866 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:51.635880 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:51.635884 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:51.635926 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:51.635982 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 06:44:51.636004 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:44:51.651980 25988 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:51.652542 25988 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:51.657938 25988 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b0e2debb4274df6bed0fb5f4ebe3bd5: Generated new TSK 0
I20260810 06:44:51.658140 25988 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:51.661895 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 25882
2026-08-10T06:44:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1500 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:51 dist-test-slave-bw88 krb5kdc[26017](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:51 dist-test-slave-bw88 krb5kdc[26017](info): set up 2 sockets
Aug 10 06:44:51 dist-test-slave-bw88 krb5kdc[26017](info): commencing operation
krb5kdc: starting...
W20260810 06:44:52.874482 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:52 dist-test-slave-bw88 krb5kdc[26017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:44:52.995533 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38823
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:34157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:38823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:53.078474 26035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:53.078708 26035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:53.078732 26035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:53.079859 26035 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:53.079901 26035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:53.079917 26035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:53.079967 26035 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:53.079988 26035 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:53.081521 26035 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:34157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:38823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:38823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:53.081768 26035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:53.081990 26035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:53.087352 26044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:53.087383 26043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:53.087383 26046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:53.088155 26035 server_base.cc:1034] running on GCE node
I20260810 06:44:53.088418 26035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:53.088706 26035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:53.089836 26035 hybrid_clock.cc:648] HybridClock initialized: now 1786344293089810 us; error 42 us; skew 500 ppm
Aug 10 06:44:53 dist-test-slave-bw88 krb5kdc[26017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344293, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:53.093189 26035 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:44:53.093765 26035 webserver.cc:460] Webserver started at http://127.27.41.190:41605/ using document root <none> and password file <none>
I20260810 06:44:53.094084 26035 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:53.094162 26035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:53.094300 26035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:53.095868 26035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "6ee61192c0d24436a31e000716479d3b"
format_stamp: "Formatted at 2026-08-10 06:44:53 on dist-test-slave-bw88"
server_key: "17b71a307b620015dbe6462823a840ed"
server_key_iv: "aa88ea544a7c60e9d7999aa3e894397a"
server_key_version: "encryptionkey@0"
I20260810 06:44:53.096342 26035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "6ee61192c0d24436a31e000716479d3b"
format_stamp: "Formatted at 2026-08-10 06:44:53 on dist-test-slave-bw88"
server_key: "17b71a307b620015dbe6462823a840ed"
server_key_iv: "aa88ea544a7c60e9d7999aa3e894397a"
server_key_version: "encryptionkey@0"
I20260810 06:44:53.098279 26035 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260810 06:44:53.098954 26057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:53.099154 26035 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:53.099251 26035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "6ee61192c0d24436a31e000716479d3b"
format_stamp: "Formatted at 2026-08-10 06:44:53 on dist-test-slave-bw88"
server_key: "17b71a307b620015dbe6462823a840ed"
server_key_iv: "aa88ea544a7c60e9d7999aa3e894397a"
server_key_version: "encryptionkey@0"
I20260810 06:44:53.099325 26035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:53.102665 26035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:53.104456 26035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:53.104605 26035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:53.108636 26035 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:38823
I20260810 06:44:53.108673 26128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:38823 every 8 connection(s)
I20260810 06:44:53.109002 26035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:53.109998 26130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:53.110515 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 26035
I20260810 06:44:53.110620 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:53.110811 27814 external_mini_cluster.cc:1428] Setting key 3d9d301a51482a3ff1cc6c0209826ac7
I20260810 06:44:53.112740 26130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b: Bootstrap starting.
I20260810 06:44:53.113181 26134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:53.111270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48409 (local address 127.27.41.190:38823)
0810 06:44:53.111437 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:53.111447 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:53.111477 (+ 30us) server_negotiation.cc:407] Connection header received
0810 06:44:53.111880 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:53.111886 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:53.111930 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:53.112142 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:53.112779 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:53.112783 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:53.112783 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:53.112787 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:53.112838 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:53.112853 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:53.112915 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:53.112980 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 06:44:53.113018 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":78,"threads_started":1}
I20260810 06:44:53.113505 26130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:53.113837 26130 log.cc:824] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:53.114094 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:53.114562 26130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b: No bootstrap required, opened a new log
I20260810 06:44:53.116400 26134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:53.115504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54709 (local address 127.27.41.190:38823)
0810 06:44:53.115554 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:53.115555 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:53.115605 (+ 50us) server_negotiation.cc:407] Connection header received
0810 06:44:53.115681 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:53.115682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:53.115685 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:53.115731 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:53.116206 (+ 475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:53.116207 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:53.116207 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:44:53.116210 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:53.116221 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:44:53.116224 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:53.116260 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:53.116322 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 06:44:53.116331 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:44:53.117080 26130 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee61192c0d24436a31e000716479d3b" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38823 } }
I20260810 06:44:53.117240 26130 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:44:53.117287 26130 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee61192c0d24436a31e000716479d3b, State: Initialized, Role: FOLLOWER
I20260810 06:44:53.117431 26130 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee61192c0d24436a31e000716479d3b" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38823 } }
I20260810 06:44:53.117534 26130 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:44:53.117580 26130 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:44:53.117630 26130 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:53.118147 26130 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee61192c0d24436a31e000716479d3b" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38823 } }
I20260810 06:44:53.118263 26130 leader_election.cc:302] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ee61192c0d24436a31e000716479d3b; no voters:
I20260810 06:44:53.118444 26130 leader_election.cc:288] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:44:53.118494 26144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:53.118690 26130 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:53.118701 26144 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [term 1 LEADER]: Becoming Leader. State: Replica: 6ee61192c0d24436a31e000716479d3b, State: Running, Role: LEADER
I20260810 06:44:53.118799 26144 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee61192c0d24436a31e000716479d3b" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38823 } }
I20260810 06:44:53.119349 26146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ee61192c0d24436a31e000716479d3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee61192c0d24436a31e000716479d3b" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38823 } } }
I20260810 06:44:53.119369 26147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ee61192c0d24436a31e000716479d3b. Latest consensus state: current_term: 1 leader_uuid: "6ee61192c0d24436a31e000716479d3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ee61192c0d24436a31e000716479d3b" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 38823 } } }
I20260810 06:44:53.119462 26146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:53.119467 26147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:53.119702 26155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:53.120216 26155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:53.121686 26155 catalog_manager.cc:1347] Generated new cluster ID: 76c099f3ccf54cea83b4f7222e97e23c
I20260810 06:44:53.121739 26155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:53.152871 26155 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:53.153067 26155 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:53.163208 26155 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ee61192c0d24436a31e000716479d3b: Generated new TSK 0
I20260810 06:44:53.163434 26155 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:44:53.175014 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 26035
2026-08-10T06:44:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1511 ms)
[----------] 18 tests from AuthTokenIssuingTest (26819 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:53 dist-test-slave-bw88 krb5kdc[26170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:53 dist-test-slave-bw88 krb5kdc[26170](info): set up 2 sockets
Aug 10 06:44:53 dist-test-slave-bw88 krb5kdc[26170](info): commencing operation
krb5kdc: starting...
W20260810 06:44:54.368647 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:44:54.486502 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:39613
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:37403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:39613,127.27.41.189:41391,127.27.41.188:41733
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:54.572058 26189 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 06:44:54.572276 26189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:54.572295 26189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:54.572316 26189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:54.573418 26189 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:54.573459 26189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:54.573475 26189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:54.573489 26189 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:54.573503 26189 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:54.575004 26189 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:39613,127.27.41.189:41391,127.27.41.188:41733
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:39613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:54.575222 26189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:54.575412 26189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:54.580315 26197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:54.580276 26200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:54.580415 26189 server_base.cc:1034] running on GCE node
W20260810 06:44:54.580277 26196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:54.580818 26189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:54.581118 26189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:54.582268 26189 hybrid_clock.cc:648] HybridClock initialized: now 1786344294582258 us; error 28 us; skew 500 ppm
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:54.584636 26189 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:44:54.585063 26189 webserver.cc:460] Webserver started at http://127.27.41.190:34409/ using document root <none> and password file <none>
I20260810 06:44:54.585281 26189 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:54.585323 26189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:54.585482 26189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:54.586486 26189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "e372e2d7b52b4a5d831ff626667bb3e4"
format_stamp: "Formatted at 2026-08-10 06:44:54 on dist-test-slave-bw88"
server_key: "586841da04885c5fa3669f9e6eb5cfd7"
server_key_iv: "a7465580fc7dca260f2ac0750cfb1725"
server_key_version: "encryptionkey@0"
I20260810 06:44:54.586786 26189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "e372e2d7b52b4a5d831ff626667bb3e4"
format_stamp: "Formatted at 2026-08-10 06:44:54 on dist-test-slave-bw88"
server_key: "586841da04885c5fa3669f9e6eb5cfd7"
server_key_iv: "a7465580fc7dca260f2ac0750cfb1725"
server_key_version: "encryptionkey@0"
I20260810 06:44:54.587981 26189 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:44:54.588642 26207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:54.588814 26189 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:54.588929 26189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "e372e2d7b52b4a5d831ff626667bb3e4"
format_stamp: "Formatted at 2026-08-10 06:44:54 on dist-test-slave-bw88"
server_key: "586841da04885c5fa3669f9e6eb5cfd7"
server_key_iv: "a7465580fc7dca260f2ac0750cfb1725"
server_key_version: "encryptionkey@0"
I20260810 06:44:54.589003 26189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:54.614370 26189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:54.616364 26189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:54.616549 26189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:54.620721 26189 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:39613
I20260810 06:44:54.620759 26283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:39613 every 8 connection(s)
I20260810 06:44:54.621133 26189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:54.621685 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 26189
I20260810 06:44:54.621841 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:54.622068 27814 external_mini_cluster.cc:1428] Setting key 72426bf02ea27675894cb5b4449fe5fd
I20260810 06:44:54.622448 26284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:54.624634 26284 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.27.41.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.189@KRBTEST.COM" created.
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:54.638087 26292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.625378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39020 (local address 127.27.41.190:39613)
0810 06:44:54.625518 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.625527 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.625647 (+ 120us) server_negotiation.cc:407] Connection header received
0810 06:44:54.626450 (+ 803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.626452 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.626468 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.626543 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.627319 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.628120 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.629492 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.629798 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.629878 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.634675 (+ 4797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.634684 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.634684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.634692 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.636388 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.636867 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.636869 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.636869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.636946 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.637205 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.637205 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.637206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.637458 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.637521 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.637760 (+ 239us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.637886 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
I20260810 06:44:54.638104 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.625283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:39613 (local address 127.0.0.1:39020)
0810 06:44:54.625505 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.625550 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:54.626291 (+ 741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:54.626592 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:54.626596 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:54.626990 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:54.627221 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.627227 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.628217 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.628219 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.629409 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.629413 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.629906 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.629908 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.630002 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.630472 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:54.630483 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:54.634587 (+ 4104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:54.636471 (+ 1884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.636478 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.636480 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.636779 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.637008 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.637009 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.637010 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.637136 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.637522 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:54.637530 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:54.637608 (+ 78us) client_negotiation.cc:769] Sending connection context
0810 06:44:54.637720 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 06:44:54.637962 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":48,"thread_start_us":110,"threads_started":1}
I20260810 06:44:54.638860 26284 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:44:54.639247 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.639110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41391 (local address 127.0.0.1:50984)
0810 06:44:54.639161 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.639215 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 06:44:54.639400 26211 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41391: connect: Connection refused (error 111)
I20260810 06:44:54.639827 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.639711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41391 (local address 127.0.0.1:50990)
0810 06:44:54.639764 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.639797 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 06:44:54.639946 26284 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.189:41391: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41391: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.189.keytab.
Entry for principal kudu/127.27.41.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.189.keytab.
I20260810 06:44:54.649111 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.189:41391
--webserver_interface=127.27.41.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.189.keytab
--principal=kudu/127.27.41.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:37403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:39613,127.27.41.189:41391,127.27.41.188:41733
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:44:54.689182 26284 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } attempt: 1
I20260810 06:44:54.689718 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.689559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41391 (local address 127.0.0.1:51004)
0810 06:44:54.689627 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.689679 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 06:44:54.690115 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.690016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41391 (local address 127.0.0.1:51008)
0810 06:44:54.690065 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.690095 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 06:44:54.690231 26284 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.189:41391: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41391: connect: Connection refused (error 111)
W20260810 06:44:54.731774 26296 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 06:44:54.731985 26296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:54.732003 26296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:54.732057 26296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:54.733152 26296 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:54.733193 26296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:54.733207 26296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:54.733254 26296 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:54.733278 26296 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:54.734772 26296 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:39613,127.27.41.189:41391,127.27.41.188:41733
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.189.keytab
--principal=kudu/127.27.41.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.189:41391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.41.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:54.735018 26296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:54.735245 26296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:54.740073 26307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:54.740104 26311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:54.740141 26305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:54.740309 26296 server_base.cc:1034] running on GCE node
I20260810 06:44:54.740562 26296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:54.740847 26296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:54.742009 26296 hybrid_clock.cc:648] HybridClock initialized: now 1786344294741999 us; error 31 us; skew 500 ppm
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:54.744529 26296 init.cc:377] Logged in from keytab as kudu/127.27.41.189@KRBTEST.COM (short username kudu)
I20260810 06:44:54.744937 26296 webserver.cc:460] Webserver started at http://127.27.41.189:44135/ using document root <none> and password file <none>
I20260810 06:44:54.745153 26296 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:54.745219 26296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:54.745397 26296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:54.746407 26296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/data/instance:
uuid: "81734860157449229b7c23cf75d3643c"
format_stamp: "Formatted at 2026-08-10 06:44:54 on dist-test-slave-bw88"
server_key: "9224d350d2c14a59c0b16172ca41b80f"
server_key_iv: "e2cb5181db778da4a5bb11f901351943"
server_key_version: "encryptionkey@0"
I20260810 06:44:54.746779 26296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/wal/instance:
uuid: "81734860157449229b7c23cf75d3643c"
format_stamp: "Formatted at 2026-08-10 06:44:54 on dist-test-slave-bw88"
server_key: "9224d350d2c14a59c0b16172ca41b80f"
server_key_iv: "e2cb5181db778da4a5bb11f901351943"
server_key_version: "encryptionkey@0"
I20260810 06:44:54.748118 26296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:44:54.748811 26320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:54.748982 26296 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:54.749078 26296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/wal
uuid: "81734860157449229b7c23cf75d3643c"
format_stamp: "Formatted at 2026-08-10 06:44:54 on dist-test-slave-bw88"
server_key: "9224d350d2c14a59c0b16172ca41b80f"
server_key_iv: "e2cb5181db778da4a5bb11f901351943"
server_key_version: "encryptionkey@0"
I20260810 06:44:54.749158 26296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:54.758399 26284 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } attempt: 2
I20260810 06:44:54.758769 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.758648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41391 (local address 127.0.0.1:51016)
0810 06:44:54.758703 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.758740 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 06:44:54.759102 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.759021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41391 (local address 127.0.0.1:51026)
0810 06:44:54.759064 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.759087 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 06:44:54.759198 26284 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.189:41391: Network error: Client connection negotiation failed: client connection to 127.27.41.189:41391: connect: Connection refused (error 111)
I20260810 06:44:54.766302 26296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:54.768013 26296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:54.768170 26296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:54.772195 26296 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.189:41391
I20260810 06:44:54.772264 26395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.189:41391 every 8 connection(s)
I20260810 06:44:54.772612 26296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/data/info.pb
I20260810 06:44:54.773739 26398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:54.773728 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 26296
I20260810 06:44:54.773861 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-1/wal/instance
I20260810 06:44:54.774032 27814 external_mini_cluster.cc:1428] Setting key b80ef97af8eb6073ea9b4b58e06b9225
I20260810 06:44:54.775378 26398 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.189@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.41.188@KRBTEST.COM; defaulting to no policy
I20260810 06:44:54.785288 26292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.776081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39034 (local address 127.27.41.190:39613)
0810 06:44:54.776158 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.776160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.776414 (+ 254us) server_negotiation.cc:407] Connection header received
0810 06:44:54.777156 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.777157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.777169 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.777241 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.777936 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.778454 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.780049 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.780248 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.780299 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.782681 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.782683 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.782683 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.782690 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.784027 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.784489 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.784490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.784491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.784547 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.784745 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.784745 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.784745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.784847 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.784896 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.785133 (+ 237us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.785227 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 06:44:54.785513 26402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.776056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:39613 (local address 127.0.0.1:39034)
0810 06:44:54.776269 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.776319 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:54.777051 (+ 732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:54.777380 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:54.777384 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:54.777649 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:54.777841 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.777845 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.778570 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.778571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.779961 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.779965 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.780348 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.780350 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.780507 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.781016 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:54.781026 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:54.782586 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:54.784171 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.784178 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.784180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.784419 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.784600 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.784600 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.784601 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.784694 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.784898 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:54.784902 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:54.785008 (+ 106us) client_negotiation.cc:769] Sending connection context
0810 06:44:54.785086 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 06:44:54.785257 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":113,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.188@KRBTEST.COM" created.
I20260810 06:44:54.786103 26398 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.189@KRBTEST.COM for kudu/127.27.41.189@KRBTEST.COM
I20260810 06:44:54.793990 26402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.786385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41391 (local address 127.0.0.1:51040)
0810 06:44:54.786576 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.786587 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:54.786639 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:54.786770 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:54.786770 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:54.786935 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:54.786996 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.786997 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.787809 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.787810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.788640 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.788643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.789319 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.789319 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.789422 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.789826 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:54.789830 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:54.790927 (+ 1097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:54.792949 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.792950 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.792951 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.793123 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.793380 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.793381 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.793381 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.793440 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.793773 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:54.793774 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:54.793809 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 06:44:54.793860 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 06:44:54.793930 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175}
I20260810 06:44:54.794132 26405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.786447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51040 (local address 127.27.41.189:41391)
0810 06:44:54.786585 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.786589 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.786633 (+ 44us) server_negotiation.cc:407] Connection header received
0810 06:44:54.786694 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.786696 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.786706 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.786766 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.787076 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.787726 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.788726 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.789245 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.789323 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.791007 (+ 1684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.791016 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.791017 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.791024 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.792870 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.793204 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.793208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.793208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.793274 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.793504 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.793506 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.793506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.793703 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.793797 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.793901 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.794008 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":7,"server-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260810 06:44:54.794687 26398 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:44:54.795018 26402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.794904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:41733 (local address 127.0.0.1:54020)
0810 06:44:54.794950 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.794993 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 06:44:54.795189 26322 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
I20260810 06:44:54.795565 26402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.795481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:41733 (local address 127.0.0.1:54022)
0810 06:44:54.795521 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.795551 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 06:44:54.795699 26398 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:41733: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.188.keytab.
Entry for principal kudu/127.27.41.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.188.keytab.
I20260810 06:44:54.804319 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.188:41733
--webserver_interface=127.27.41.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.188.keytab
--principal=kudu/127.27.41.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:37403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:39613,127.27.41.189:41391,127.27.41.188:41733
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:44:54.844930 26398 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } attempt: 1
I20260810 06:44:54.845521 26402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.845389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:41733 (local address 127.0.0.1:54034)
0810 06:44:54.845449 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.845491 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 06:44:54.845871 26402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.845793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:41733 (local address 127.0.0.1:54046)
0810 06:44:54.845831 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.845856 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260810 06:44:54.845994 26398 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:41733: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
I20260810 06:44:54.850345 26284 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } attempt: 3
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for kudu/127.27.41.189@KRBTEST.COM
I20260810 06:44:54.857456 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.850629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41391 (local address 127.0.0.1:51052)
0810 06:44:54.850683 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.850695 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:54.850765 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:54.850904 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:54.850905 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:54.851077 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:54.851160 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.851162 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.851880 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.851881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.852460 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.852462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.853025 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.853026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.853088 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.853599 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:54.853603 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:54.854812 (+ 1209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:54.856492 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.856493 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.856494 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.856661 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.856857 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.856857 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.856858 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.856910 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.857165 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:54.857166 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:54.857207 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 06:44:54.857257 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 06:44:54.857367 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 06:44:54.857506 26405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.850705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51052 (local address 127.27.41.189:41391)
0810 06:44:54.850762 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.850765 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.850776 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:44:54.850827 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.850828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.850841 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.850897 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.851243 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.851797 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.852562 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.852944 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.853019 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.854893 (+ 1874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.854894 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.854895 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.854902 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.856415 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.856728 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.856729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.856730 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.856792 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.856966 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.856966 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.856967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.857103 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.857171 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.857292 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.857397 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 06:44:54.858139 26284 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:44:54.858471 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.858375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:41733 (local address 127.0.0.1:54050)
0810 06:44:54.858420 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.858447 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 06:44:54.858824 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.858747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:41733 (local address 127.0.0.1:54064)
0810 06:44:54.858787 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.858810 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260810 06:44:54.858929 26284 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:41733: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
W20260810 06:44:54.889721 26408 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 06:44:54.889918 26408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:54.889935 26408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:54.889953 26408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 06:44:54.890102 26284 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } attempt: 1
I20260810 06:44:54.890554 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.890411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:41733 (local address 127.0.0.1:54074)
0810 06:44:54.890470 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.890514 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 06:44:54.890928 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.890846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:41733 (local address 127.0.0.1:54080)
0810 06:44:54.890887 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.890912 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 06:44:54.891043 26284 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:41733: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
W20260810 06:44:54.891400 26408 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:54.891445 26408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:54.891460 26408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:54.891474 26408 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:54.891485 26408 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:54.892973 26408 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:37403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:39613,127.27.41.189:41391,127.27.41.188:41733
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.188.keytab
--principal=kudu/127.27.41.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.188:41733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.41.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:54.893183 26408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:54.893414 26408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:54.898259 26425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:54.898310 26417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:54.898283 26419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:54.898512 26408 server_base.cc:1034] running on GCE node
I20260810 06:44:54.898741 26408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:54.898972 26408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:54.900151 26408 hybrid_clock.cc:648] HybridClock initialized: now 1786344294900136 us; error 28 us; skew 500 ppm
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:54.902791 26408 init.cc:377] Logged in from keytab as kudu/127.27.41.188@KRBTEST.COM (short username kudu)
I20260810 06:44:54.903266 26408 webserver.cc:460] Webserver started at http://127.27.41.188:38973/ using document root <none> and password file <none>
I20260810 06:44:54.903488 26408 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:54.903551 26408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:54.903704 26408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:54.904742 26408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/data/instance:
uuid: "c30b369541ab446a93e9047bb6964cef"
format_stamp: "Formatted at 2026-08-10 06:44:54 on dist-test-slave-bw88"
server_key: "a1a8a9f09cd62180394dc49a8ecab8ee"
server_key_iv: "0fcc1b1ba37d0eae3d632d0687852009"
server_key_version: "encryptionkey@0"
I20260810 06:44:54.905120 26408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/wal/instance:
uuid: "c30b369541ab446a93e9047bb6964cef"
format_stamp: "Formatted at 2026-08-10 06:44:54 on dist-test-slave-bw88"
server_key: "a1a8a9f09cd62180394dc49a8ecab8ee"
server_key_iv: "0fcc1b1ba37d0eae3d632d0687852009"
server_key_version: "encryptionkey@0"
I20260810 06:44:54.906525 26408 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260810 06:44:54.907255 26439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:54.907415 26408 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:54.907514 26408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/wal
uuid: "c30b369541ab446a93e9047bb6964cef"
format_stamp: "Formatted at 2026-08-10 06:44:54 on dist-test-slave-bw88"
server_key: "a1a8a9f09cd62180394dc49a8ecab8ee"
server_key_iv: "0fcc1b1ba37d0eae3d632d0687852009"
server_key_version: "encryptionkey@0"
I20260810 06:44:54.907590 26408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:54.914146 26398 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } attempt: 2
I20260810 06:44:54.914564 26402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.914430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:41733 (local address 127.0.0.1:54088)
0810 06:44:54.914486 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.914524 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 06:44:54.914891 26402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.914793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:41733 (local address 127.0.0.1:54104)
0810 06:44:54.914843 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.914867 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 06:44:54.914974 26398 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:41733: Network error: Client connection negotiation failed: client connection to 127.27.41.188:41733: connect: Connection refused (error 111)
I20260810 06:44:54.930792 26408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:54.933192 26408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:54.933409 26408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:54.937932 26408 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.188:41733
I20260810 06:44:54.937969 26522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.188:41733 every 8 connection(s)
I20260810 06:44:54.938349 26408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/data/info.pb
I20260810 06:44:54.939421 26523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:54.939896 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 26408
I20260810 06:44:54.940021 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786344020082892-27814-0/minicluster-data/master-2/wal/instance
I20260810 06:44:54.940210 27814 external_mini_cluster.cc:1428] Setting key 8b8283dab6fc0baa1367eeb0a4e092c4
I20260810 06:44:54.941730 26523 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.188@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.188@KRBTEST.COM
I20260810 06:44:54.950546 26292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.942482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39046 (local address 127.27.41.190:39613)
0810 06:44:54.942523 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.942525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.942757 (+ 232us) server_negotiation.cc:407] Connection header received
0810 06:44:54.942824 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.942824 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.942834 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.942879 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.943451 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.943947 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.944887 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.945099 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.945171 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.947379 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.947380 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.947380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.947386 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.948979 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.949550 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.949551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.949552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.949617 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.949869 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.949870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.949871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.949987 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.950061 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.950354 (+ 293us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.950456 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:44:54.950738 26529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.942451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:39613 (local address 127.0.0.1:39046)
0810 06:44:54.942643 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.942681 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:54.942759 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:54.942914 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:54.942917 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:54.943260 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:54.943373 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.943378 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.944036 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.944037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.944807 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.944808 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.945227 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.945228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.945289 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.945850 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:54.945858 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:54.947274 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:54.949087 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.949095 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.949097 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.949460 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.949681 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.949682 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.949682 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.949796 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.950065 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:54.950073 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:54.950206 (+ 133us) client_negotiation.cc:769] Sending connection context
0810 06:44:54.950305 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 06:44:54.950479 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":95,"threads_started":1}
I20260810 06:44:54.950747 26527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.940758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54108 (local address 127.27.41.188:41733)
0810 06:44:54.940986 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.940995 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.941037 (+ 42us) server_negotiation.cc:407] Connection header received
0810 06:44:54.941608 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.941618 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.941681 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.941840 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.942617 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.943815 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.944577 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.944994 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.945075 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.947808 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.947816 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.947817 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.947828 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.949486 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.949842 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.949845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.949845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.949903 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.950124 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.950125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.950125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.950265 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.950448 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.950528 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.950609 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260810 06:44:54.951372 26523 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.188@KRBTEST.COM for kudu/127.27.41.189@KRBTEST.COM
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:54.958842 26529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.951595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:41391 (local address 127.0.0.1:51064)
0810 06:44:54.951744 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.951753 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:54.951786 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:54.951904 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:54.951905 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:54.952050 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:54.952111 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.952113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.953030 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.953031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.953855 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.953857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.954305 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.954306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.954375 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.954745 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:54.954749 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:54.956038 (+ 1289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:54.957827 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.957828 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.957828 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.958002 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.958213 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.958214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.958214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.958271 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.958532 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:54.958533 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:54.958575 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 06:44:54.958655 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 06:44:54.958747 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260810 06:44:54.958842 26405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.951703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51064 (local address 127.27.41.189:41391)
0810 06:44:54.951765 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.951767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.951779 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:44:54.951851 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.951852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.951859 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.951899 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.952193 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.952960 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.953933 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.954236 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.954296 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.956135 (+ 1839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.956136 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.956136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.956144 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.957725 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.958073 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.958075 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.958075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.958149 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.958335 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.958336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.958337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.958452 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.958538 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.958680 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.958752 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 06:44:54.959003 26292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.951566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39058 (local address 127.27.41.190:39613)
0810 06:44:54.951599 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.951601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.951613 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:44:54.951684 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.951685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.951692 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.951759 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.952340 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.953010 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.953932 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.954217 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.954290 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.956607 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.956608 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.956609 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.956616 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.957882 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.958259 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.958261 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.958261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.958317 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.958507 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.958508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.958508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.958612 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.958780 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.958815 (+ 35us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.958897 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 06:44:54.959681 26523 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.188@KRBTEST.COM for kudu/127.27.41.188@KRBTEST.COM
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.189@KRBTEST.COM
I20260810 06:44:54.966063 26529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.959911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:41733 (local address 127.0.0.1:54112)
0810 06:44:54.959953 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.959962 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:54.959994 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:54.960131 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:54.960131 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:54.960280 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:54.960310 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.960311 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.960916 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.960917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.961449 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.961451 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.961826 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.961827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.961878 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.962360 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:54.962365 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:54.963480 (+ 1115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:54.965001 (+ 1521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.965002 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.965003 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.965213 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.965464 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.965464 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.965465 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.965514 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.965815 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:54.965816 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:54.965856 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 06:44:54.965927 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 06:44:54.966004 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 06:44:54.966128 26527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.959940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54112 (local address 127.27.41.188:41733)
0810 06:44:54.959983 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.959985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.959994 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:44:54.960051 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.960052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.960062 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.960129 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.960379 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.960840 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.961534 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.961739 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.961815 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.963563 (+ 1748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.963565 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.963565 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.963572 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.964925 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.965286 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.965288 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.965288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.965394 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.965575 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.965576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.965576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.965719 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.965799 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.965973 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.966069 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":24}
I20260810 06:44:54.966194 26284 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } attempt: 2
I20260810 06:44:54.967298 26405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.959594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51074 (local address 127.27.41.189:41391)
0810 06:44:54.959628 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.959629 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.959636 (+ 7us) server_negotiation.cc:407] Connection header received
0810 06:44:54.959680 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.959680 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.959690 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.959738 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.960284 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.960775 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.961515 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.961729 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.961780 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.964171 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.964173 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.964173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.964179 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.965884 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.966518 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.966519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.966519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.966581 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.966770 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.966770 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.966771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.966911 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.967089 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.967132 (+ 43us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.967210 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 06:44:54.968011 26523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef: Bootstrap starting.
I20260810 06:44:54.968997 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:54.969170 26523 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:54.969539 26523 log.cc:824] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:54.970513 26523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef: No bootstrap required, opened a new log
Aug 10 06:44:54 dist-test-slave-bw88 krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for kudu/127.27.41.188@KRBTEST.COM
I20260810 06:44:54.970345 26245 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "e372e2d7b52b4a5d831ff626667bb3e4"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39058
I20260810 06:44:54.972287 26523 raft_consensus.cc:348] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } }
I20260810 06:44:54.972473 26523 raft_consensus.cc:729] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c30b369541ab446a93e9047bb6964cef, State: Initialized, Role: FOLLOWER
I20260810 06:44:54.972575 26523 consensus_queue.cc:260] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } }
I20260810 06:44:54.972970 26523 sys_catalog.cc:564] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:54.972932 26532 sys_catalog.cc:455] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } } }
I20260810 06:44:54.973049 26532 sys_catalog.cc:458] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:44:54.974627 26291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.966461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:41733 (local address 127.0.0.1:54114)
0810 06:44:54.966513 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:54.966523 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:54.966564 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:54.966892 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:54.966893 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:54.967049 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:54.967090 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.967093 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.967922 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.967923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.969290 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:54.969293 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.969694 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.969695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:54.969752 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.970132 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:54.970138 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:54.971538 (+ 1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:54.973322 (+ 1784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.973323 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.973323 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.973575 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.973871 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:54.973872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:54.973873 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:54.973955 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:54.974265 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:54.974266 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:54.974321 (+ 55us) client_negotiation.cc:769] Sending connection context
0810 06:44:54.974404 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 06:44:54.974512 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 06:44:54.974928 26527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.966502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54114 (local address 127.27.41.188:41733)
0810 06:44:54.966537 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.966538 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.966548 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:44:54.966802 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.966803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.966814 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.966874 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.967181 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.967844 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.969411 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.969612 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.969692 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.971609 (+ 1917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.971627 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.971627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.971634 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.973240 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.973699 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.973700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.973700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.973768 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.974035 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.974036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.974036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.974198 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.974272 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.974764 (+ 492us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.974841 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 06:44:54.975289 26549 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:44:54.975346 26549 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:44:54.976109 26284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4: Bootstrap starting.
I20260810 06:44:54.976672 26284 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:54.976914 26284 log.cc:824] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:54.977805 26284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4: No bootstrap required, opened a new log
I20260810 06:44:54.975456 26408 master_runner.cc:186] Error getting master registration for 127.27.41.190:39613: OK, instance_id { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" instance_seqno: 1786344294619575 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 06:44:54.978009 26408 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:44:54.978880 26284 raft_consensus.cc:348] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } }
I20260810 06:44:54.978991 26284 raft_consensus.cc:729] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e372e2d7b52b4a5d831ff626667bb3e4, State: Initialized, Role: FOLLOWER
I20260810 06:44:54.979044 26284 consensus_queue.cc:260] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } }
I20260810 06:44:54.979264 26555 sys_catalog.cc:455] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } } }
I20260810 06:44:54.979313 26284 sys_catalog.cc:564] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:54.979364 26245 raft_consensus.cc:482] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 06:44:54.979430 26245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:54.980193 26245 raft_consensus.cc:504] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } }
I20260810 06:44:54.980484 26245 leader_election.cc:288] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [CANDIDATE]: Term 1 election: Requested vote from peers 81734860157449229b7c23cf75d3643c (127.27.41.189:41391), c30b369541ab446a93e9047bb6964cef (127.27.41.188:41733)
I20260810 06:44:54.980733 26486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c30b369541ab446a93e9047bb6964cef"
I20260810 06:44:54.980861 26486 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:54.980886 26555 sys_catalog.cc:458] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:44:54.981851 26486 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e372e2d7b52b4a5d831ff626667bb3e4 in term 1.
I20260810 06:44:54.982856 26208 leader_election.cc:302] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c30b369541ab446a93e9047bb6964cef, e372e2d7b52b4a5d831ff626667bb3e4; no voters:
I20260810 06:44:54.983079 26555 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:54.983235 26555 raft_consensus.cc:686] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [term 1 LEADER]: Becoming Leader. State: Replica: e372e2d7b52b4a5d831ff626667bb3e4, State: Running, Role: LEADER
I20260810 06:44:54.983327 26555 consensus_queue.cc:237] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } }
I20260810 06:44:54.983752 26555 sys_catalog.cc:455] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e372e2d7b52b4a5d831ff626667bb3e4. Latest consensus state: current_term: 1 leader_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } } }
I20260810 06:44:54.983825 26555 sys_catalog.cc:458] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:54.984477 26189 master_runner.cc:186] Error getting master registration for 127.27.41.189:41391: OK, instance_id { permanent_uuid: "81734860157449229b7c23cf75d3643c" instance_seqno: 1786344294771093 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 06:44:54.987458 26189 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:44:54.990518 26578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:54.993314 26292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.982173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39060 (local address 127.27.41.190:39613)
0810 06:44:54.982256 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.982258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.982265 (+ 7us) server_negotiation.cc:407] Connection header received
0810 06:44:54.982282 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.982283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.982292 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.982351 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.983632 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.984390 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.985912 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.986228 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.986272 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.990170 (+ 3898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.990172 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.990172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.990180 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.991937 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.992446 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.992448 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.992448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.992510 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.992716 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.992717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.992717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.992844 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.992931 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.993142 (+ 211us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.993226 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 06:44:54.994434 26405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.982132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51086 (local address 127.27.41.189:41391)
0810 06:44:54.982189 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.982191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.982525 (+ 334us) server_negotiation.cc:407] Connection header received
0810 06:44:54.982625 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.982626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.982638 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.982668 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.983649 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.984390 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.985566 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.985884 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.985925 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.990128 (+ 4203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.990130 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.990130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.990139 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.993040 (+ 2901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.993495 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.993496 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.993497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.993559 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.993803 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.993804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.993805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.993930 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.994023 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.994247 (+ 224us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.994330 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 06:44:54.994778 26578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:54.996537 26527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:54.982063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54126 (local address 127.27.41.188:41733)
0810 06:44:54.982098 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:54.982101 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:54.982592 (+ 491us) server_negotiation.cc:407] Connection header received
0810 06:44:54.982615 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:54.982616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:54.982626 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:54.982684 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:54.988202 (+ 5518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.988930 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.989989 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:54.990277 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:54.990348 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:54.992669 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:54.992671 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:54.992671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:54.992680 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:54.994823 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.995686 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.995687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.995688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.995746 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:54.995936 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:54.995937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:54.995937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:54.996085 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:54.996181 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:54.996344 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 06:44:54.996431 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 06:44:54.998338 26486 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef [term 1 FOLLOWER]: Refusing update from remote peer e372e2d7b52b4a5d831ff626667bb3e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:54.998698 26576 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:55.000103 26532 sys_catalog.cc:455] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef [sys.catalog]: SysCatalogTable state changed. Reason: New leader e372e2d7b52b4a5d831ff626667bb3e4. Latest consensus state: current_term: 1 leader_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } } }
I20260810 06:44:55.000198 26532 sys_catalog.cc:458] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:44:55.006094 26398 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } attempt: 3
I20260810 06:44:55.010342 26555 sys_catalog.cc:455] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } } }
I20260810 06:44:55.010462 26555 sys_catalog.cc:458] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:55.010936 26580 mvcc.cc:205] Tried to move back new op lower bound from 7316866232310411264 to 7316866232252481536. Current Snapshot: MvccSnapshot[applied={T|T < 7316866232310411264}]
I20260810 06:44:55.010977 26532 sys_catalog.cc:455] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } } }
I20260810 06:44:55.011057 26532 sys_catalog.cc:458] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:44:55.011199 26578 catalog_manager.cc:1347] Generated new cluster ID: c3d1a721169d4cb0b1a3bf98efb3d43f
I20260810 06:44:55.011243 26578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:44:55.011435 26581 mvcc.cc:205] Tried to move back new op lower bound from 7316866232310411264 to 7316866232252481536. Current Snapshot: MvccSnapshot[applied={T|T < 7316866232310411264}]
Aug 10 06:44:55 dist-test-slave-bw88 krb5kdc[26170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344294, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.189@KRBTEST.COM for kudu/127.27.41.188@KRBTEST.COM
I20260810 06:44:55.016419 26527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:55.006531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54134 (local address 127.27.41.188:41733)
0810 06:44:55.006566 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.006568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.006587 (+ 19us) server_negotiation.cc:407] Connection header received
0810 06:44:55.006607 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.006608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.006617 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.006668 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.006973 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:55.007655 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:55.009703 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:55.010059 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:55.010119 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:55.013208 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:55.013210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:55.013210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:55.013217 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:55.015064 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:55.015453 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:55.015454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:55.015455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:55.015514 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:55.015700 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:55.015701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:55.015702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:55.015933 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:55.016026 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:55.016160 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 06:44:55.016286 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 06:44:55.016319 26402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:55.006357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:41733 (local address 127.0.0.1:54134)
0810 06:44:55.006404 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:55.006414 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:55.006450 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:55.006674 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:55.006675 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:55.006857 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:55.006908 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:55.006910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:55.008397 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:55.008398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:55.009193 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:55.009195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:55.010176 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:55.010177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:55.010241 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:55.011588 (+ 1347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:55.011594 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:55.013115 (+ 1521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:55.015149 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:55.015151 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:55.015151 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:55.015375 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:55.015585 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:55.015586 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:55.015587 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:55.015649 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:55.015999 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:55.016000 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:55.016044 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 06:44:55.016113 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 06:44:55.016217 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 06:44:55.018461 26398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c: Bootstrap starting.
I20260810 06:44:55.019241 26398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:55.019583 26398 log.cc:824] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:55.020805 26398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c: No bootstrap required, opened a new log
I20260810 06:44:55.023011 26398 raft_consensus.cc:348] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } }
I20260810 06:44:55.023154 26398 raft_consensus.cc:729] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81734860157449229b7c23cf75d3643c, State: Initialized, Role: FOLLOWER
I20260810 06:44:55.023240 26398 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } }
I20260810 06:44:55.023562 26398 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:55.023669 26362 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:55.024718 26362 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c [term 1 FOLLOWER]: Refusing update from remote peer e372e2d7b52b4a5d831ff626667bb3e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:55.024919 26363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "81734860157449229b7c23cf75d3643c"
I20260810 06:44:55.026237 26363 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e372e2d7b52b4a5d831ff626667bb3e4 in term 1.
I20260810 06:44:55.026511 26576 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:55.028950 26589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } } }
I20260810 06:44:55.029036 26589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:44:55.029093 26589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } } }
I20260810 06:44:55.029871 26606 mvcc.cc:205] Tried to move back new op lower bound from 7316866232310411264 to 7316866232252481536. Current Snapshot: MvccSnapshot[applied={T|T < 7316866232310411264}]
I20260810 06:44:55.029145 26589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c [sys.catalog]: This master's current role is: FOLLOWER
W20260810 06:44:55.030550 26603 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:44:55.030611 26603 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:44:55.033506 26604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e372e2d7b52b4a5d831ff626667bb3e4. Latest consensus state: current_term: 1 leader_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } } }
I20260810 06:44:55.033602 26604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:44:55.034087 26576 sys_catalog.cc:455] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e372e2d7b52b4a5d831ff626667bb3e4" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 39613 } } peers { permanent_uuid: "81734860157449229b7c23cf75d3643c" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 41391 } } peers { permanent_uuid: "c30b369541ab446a93e9047bb6964cef" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 41733 } } }
I20260810 06:44:55.034183 26576 sys_catalog.cc:458] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:55.036023 26578 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:55.036727 26578 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:55.050719 26578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e372e2d7b52b4a5d831ff626667bb3e4: Generated new TSK 0
I20260810 06:44:55.051005 26578 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 06:44:55.082348 26405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:55.080586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51094 (local address 127.27.41.189:41391)
0810 06:44:55.080631 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.080633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.081659 (+ 1026us) server_negotiation.cc:407] Connection header received
0810 06:44:55.081768 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.081769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.081780 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.081810 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.082279 (+ 469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51094: BlockingRecv error: recv got EOF from 127.0.0.1:51094 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260810 06:44:55.083148 26292 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:55.081039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39066 (local address 127.27.41.190:39613)
0810 06:44:55.081079 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.081081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.082611 (+ 1530us) server_negotiation.cc:407] Connection header received
0810 06:44:55.082710 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.082711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.082722 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.082752 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.083073 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39066: BlockingRecv error: recv got EOF from 127.0.0.1:39066 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 06:44:55.083858 26527 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:55.081384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54138 (local address 127.27.41.188:41733)
0810 06:44:55.081424 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.081426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.083344 (+ 1918us) server_negotiation.cc:407] Connection header received
0810 06:44:55.083474 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.083476 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.083486 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.083514 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.083803 (+ 289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54138: BlockingRecv error: recv got EOF from 127.0.0.1:54138 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260810 06:44:55.094190 26405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:55.091839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51110 (local address 127.27.41.189:41391)
0810 06:44:55.091879 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.091881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.093570 (+ 1689us) server_negotiation.cc:407] Connection header received
0810 06:44:55.093708 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.093709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.093731 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.093763 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.094123 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51110: BlockingRecv error: recv got EOF from 127.0.0.1:51110 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 06:44:55.097371 26405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:55.096508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51120 (local address 127.27.41.189:41391)
0810 06:44:55.096543 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.096545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.096806 (+ 261us) server_negotiation.cc:407] Connection header received
0810 06:44:55.096908 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.096909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.096919 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.096950 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.097297 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51120: BlockingRecv error: recv got EOF from 127.0.0.1:51120 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 06:44:55.104652 26405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:55.103785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51130 (local address 127.27.41.189:41391)
0810 06:44:55.103821 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.103823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.104090 (+ 267us) server_negotiation.cc:407] Connection header received
0810 06:44:55.104196 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.104196 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.104207 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.104237 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.104603 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51130: BlockingRecv error: recv got EOF from 127.0.0.1:51130 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 06:44:55.110931 26405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:55.110032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51142 (local address 127.27.41.189:41391)
0810 06:44:55.110088 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.110090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.110352 (+ 262us) server_negotiation.cc:407] Connection header received
0810 06:44:55.110492 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.110493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.110505 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.110537 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.110885 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51142: BlockingRecv error: recv got EOF from 127.0.0.1:51142 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260810 06:44:55.121155 26405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:55.120211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51156 (local address 127.27.41.189:41391)
0810 06:44:55.120251 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.120253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.120580 (+ 327us) server_negotiation.cc:407] Connection header received
0810 06:44:55.120684 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.120685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.120696 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.120725 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.121082 (+ 357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51156: BlockingRecv error: recv got EOF from 127.0.0.1:51156 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 06:44:55.139564 26405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:55.138571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51168 (local address 127.27.41.189:41391)
0810 06:44:55.138616 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.138618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.138907 (+ 289us) server_negotiation.cc:407] Connection header received
0810 06:44:55.139035 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.139036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.139048 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.139079 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.139504 (+ 425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51168: BlockingRecv error: recv got EOF from 127.0.0.1:51168 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 06:44:55.173848 26405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:55.172960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51182 (local address 127.27.41.189:41391)
0810 06:44:55.173028 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.173031 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.173199 (+ 168us) server_negotiation.cc:407] Connection header received
0810 06:44:55.173295 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.173296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.173312 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.173405 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.173791 (+ 386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51182: BlockingRecv error: recv got EOF from 127.0.0.1:51182 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 06:44:55.239828 26405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:55.239092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51194 (local address 127.27.41.189:41391)
0810 06:44:55.239189 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.239191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.239263 (+ 72us) server_negotiation.cc:407] Connection header received
0810 06:44:55.239328 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.239330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.239340 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.239385 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.239762 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51194: BlockingRecv error: recv got EOF from 127.0.0.1:51194 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260810 06:44:55.369948 26405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:55.368993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51204 (local address 127.27.41.189:41391)
0810 06:44:55.369176 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.369178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.369302 (+ 124us) server_negotiation.cc:407] Connection header received
0810 06:44:55.369448 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.369450 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.369461 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.369523 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.369883 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51204: BlockingRecv error: recv got EOF from 127.0.0.1:51204 (error 108)
Metrics: {"server-negotiator.queue_time_us":144}
W20260810 06:44:55.627828 26405 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:55.627203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51218 (local address 127.27.41.189:41391)
0810 06:44:55.627264 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:55.627266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:55.627291 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:44:55.627368 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:55.627369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:55.627379 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:55.627433 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:55.627776 (+ 343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51218: BlockingRecv error: recv got EOF from 127.0.0.1:51218 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 06:44:55.975863 26549 catalog_manager.cc:1259] Loaded cluster ID: c3d1a721169d4cb0b1a3bf98efb3d43f
I20260810 06:44:55.976003 26549 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef: loading cluster ID for follower catalog manager: success
I20260810 06:44:55.976877 26549 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef: acquiring CA information for follower catalog manager: success
I20260810 06:44:55.977174 26549 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c30b369541ab446a93e9047bb6964cef: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:44:56.031154 26603 catalog_manager.cc:1259] Loaded cluster ID: c3d1a721169d4cb0b1a3bf98efb3d43f
I20260810 06:44:56.031234 26603 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c: loading cluster ID for follower catalog manager: success
I20260810 06:44:56.031996 26603 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c: acquiring CA information for follower catalog manager: success
I20260810 06:44:56.032240 26603 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 81734860157449229b7c23cf75d3643c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:44:56.143934 26698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:56.141096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51234 (local address 127.27.41.189:41391)
0810 06:44:56.141248 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:56.141250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:56.141299 (+ 49us) server_negotiation.cc:407] Connection header received
0810 06:44:56.141418 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:56.141420 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:56.141489 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:56.141581 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:56.141745 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:56.142259 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:56.143084 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:56.143295 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:56.143369 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:56.143561 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:56.143681 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:56.143767 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:56.143808 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 06:44:56.143829 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":71,"threads_started":1}
I20260810 06:44:56.148095 26705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:56.145879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54144 (local address 127.27.41.188:41733)
0810 06:44:56.146012 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:56.146013 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:56.146022 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:44:56.146063 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:56.146064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:56.146100 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:56.146165 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:56.146265 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:56.146731 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:56.147421 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:56.147621 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:56.147668 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:56.147786 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:56.147876 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:56.147929 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:56.147960 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 06:44:56.147977 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":71,"threads_started":1}
I20260810 06:44:56.152671 26698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:56.149838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51248 (local address 127.27.41.189:41391)
0810 06:44:56.149878 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:56.149880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:56.149973 (+ 93us) server_negotiation.cc:407] Connection header received
0810 06:44:56.150058 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:56.150060 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:56.150069 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:56.150161 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:56.150379 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:56.150871 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:56.151829 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:56.152150 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:56.152217 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:56.152336 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:56.152367 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:56.152433 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:56.152544 (+ 111us) server_negotiation.cc:299] Negotiation successful
0810 06:44:56.152566 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 06:44:56.152922 26705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:56.149969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54150 (local address 127.27.41.188:41733)
0810 06:44:56.150004 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:56.150007 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:56.150202 (+ 195us) server_negotiation.cc:407] Connection header received
0810 06:44:56.150277 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:56.150278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:56.150288 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:56.150337 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:56.150466 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:56.151156 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:56.152154 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:56.152456 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:56.152521 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:56.152669 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:56.152701 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:56.152743 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:56.152842 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 06:44:56.152862 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 06:44:56.153326 26714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:56.149796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39078 (local address 127.27.41.190:39613)
0810 06:44:56.149943 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:56.149945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:56.149976 (+ 31us) server_negotiation.cc:407] Connection header received
0810 06:44:56.150024 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:56.150025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:56.150088 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:56.150176 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:56.150317 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:56.151082 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:56.152146 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:56.152456 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:56.152545 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:56.152977 (+ 432us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:56.153084 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:56.153139 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:56.153225 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 06:44:56.153252 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":58,"threads_started":1}
I20260810 06:44:56.154902 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 26189
I20260810 06:44:56.172094 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 26296
I20260810 06:44:56.180981 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 26408
2026-08-10T06:44:56Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3004 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:44:56 dist-test-slave-bw88 krb5kdc[26721](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:44:56 dist-test-slave-bw88 krb5kdc[26721](info): set up 2 sockets
Aug 10 06:44:56 dist-test-slave-bw88 krb5kdc[26721](info): commencing operation
krb5kdc: starting...
W20260810 06:44:57.375617 27814 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/test-user.keytab.
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:44:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:44:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.41.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
Entry for principal kudu/127.27.41.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab.
I20260810 06:44:57.496380 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:35651
--webserver_interface=127.27.41.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:35651,127.27.41.189:40091,127.27.41.188:43091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:44:57.581857 26735 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 06:44:57.582099 26735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:57.582131 26735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:57.582170 26735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:57.583267 26735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:57.583333 26735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:57.583357 26735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:57.583377 26735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:57.583405 26735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:57.584854 26735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:35651,127.27.41.189:40091,127.27.41.188:43091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.190.keytab
--principal=kudu/127.27.41.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.190:35651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.41.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:57.585119 26735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:57.585361 26735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:57.590143 26747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:57.590224 26745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:57.590142 26744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:57.590472 26735 server_base.cc:1034] running on GCE node
I20260810 06:44:57.590730 26735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:57.590960 26735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:57.592231 26735 hybrid_clock.cc:648] HybridClock initialized: now 1786344297592218 us; error 32 us; skew 500 ppm
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:57.600066 26735 init.cc:377] Logged in from keytab as kudu/127.27.41.190@KRBTEST.COM (short username kudu)
I20260810 06:44:57.600590 26735 webserver.cc:460] Webserver started at http://127.27.41.190:46395/ using document root <none> and password file <none>
I20260810 06:44:57.600823 26735 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:57.600888 26735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:57.601035 26735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:57.602171 26735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/data/instance:
uuid: "b9d682bc0eb842049adfd4884571da58"
format_stamp: "Formatted at 2026-08-10 06:44:57 on dist-test-slave-bw88"
server_key: "1d58f55d1aba1a0b8fe59c8267a08531"
server_key_iv: "12cdc91e4720ae1cceb20b711f2012eb"
server_key_version: "encryptionkey@0"
I20260810 06:44:57.602545 26735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/wal/instance:
uuid: "b9d682bc0eb842049adfd4884571da58"
format_stamp: "Formatted at 2026-08-10 06:44:57 on dist-test-slave-bw88"
server_key: "1d58f55d1aba1a0b8fe59c8267a08531"
server_key_iv: "12cdc91e4720ae1cceb20b711f2012eb"
server_key_version: "encryptionkey@0"
I20260810 06:44:57.603832 26735 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:44:57.604514 26755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:57.604692 26735 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:57.604794 26735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/wal
uuid: "b9d682bc0eb842049adfd4884571da58"
format_stamp: "Formatted at 2026-08-10 06:44:57 on dist-test-slave-bw88"
server_key: "1d58f55d1aba1a0b8fe59c8267a08531"
server_key_iv: "12cdc91e4720ae1cceb20b711f2012eb"
server_key_version: "encryptionkey@0"
I20260810 06:44:57.604863 26735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:57.634859 26735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:57.637017 26735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:57.637180 26735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:57.642091 26735 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.190:35651
I20260810 06:44:57.642153 26830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.190:35651 every 8 connection(s)
I20260810 06:44:57.642603 26735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/data/info.pb
I20260810 06:44:57.643829 26832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:57.646242 26832 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:44:57.652346 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 26735
I20260810 06:44:57.652458 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-0/wal/instance
I20260810 06:44:57.652653 27814 external_mini_cluster.cc:1428] Setting key 3772df7730903021a5cfb6a84d8aaf1b
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:57.658833 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.646942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:35651 (local address 127.0.0.1:51962)
0810 06:44:57.649041 (+ 2099us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.649092 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:57.649820 (+ 728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:57.650161 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:57.650163 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:57.650530 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:57.650760 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.650766 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.652034 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.652034 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.652725 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.652727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.653259 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.653260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.653327 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.653878 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:57.653886 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:57.655220 (+ 1334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:57.657271 (+ 2051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.657279 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.657281 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.657583 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.657865 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.657865 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.657865 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.657949 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.658410 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:57.658414 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:57.658470 (+ 56us) client_negotiation.cc:769] Sending connection context
0810 06:44:57.658547 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 06:44:57.658673 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2039,"thread_start_us":825,"threads_started":1}
I20260810 06:44:57.659111 26835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.648978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51962 (local address 127.27.41.190:35651)
0810 06:44:57.649119 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:57.649138 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:57.649175 (+ 37us) server_negotiation.cc:407] Connection header received
0810 06:44:57.650004 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:57.650006 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:57.650026 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:57.650154 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:57.650867 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.651939 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.652811 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.653161 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.653278 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.655319 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:57.655326 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:57.655326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:57.655333 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:57.657188 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.657670 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.657674 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.657674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.657785 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.658022 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.658024 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.658024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.658340 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:57.658434 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:57.658617 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 06:44:57.658764 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":106,"thread_start_us":80,"threads_started":1}
I20260810 06:44:57.659792 26832 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:44:57.660128 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.660022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:40091 (local address 127.0.0.1:42196)
0810 06:44:57.660066 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.660111 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:40091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 06:44:57.660283 26758 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.41.189:40091: connect: Connection refused (error 111)
I20260810 06:44:57.660706 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.660614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:40091 (local address 127.0.0.1:42206)
0810 06:44:57.660666 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.660691 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:40091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 06:44:57.660938 26832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.189:40091: Network error: Client connection negotiation failed: client connection to 127.27.41.189:40091: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.27.41.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.189.keytab.
Entry for principal kudu/127.27.41.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.189.keytab.
I20260810 06:44:57.679800 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.189:40091
--webserver_interface=127.27.41.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.189.keytab
--principal=kudu/127.27.41.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:35651,127.27.41.189:40091,127.27.41.188:43091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:44:57.710153 26832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } attempt: 1
I20260810 06:44:57.710644 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.710497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:40091 (local address 127.0.0.1:42210)
0810 06:44:57.710579 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.710614 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:40091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260810 06:44:57.710975 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.710886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:40091 (local address 127.0.0.1:42222)
0810 06:44:57.710927 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.710956 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:40091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 06:44:57.711077 26832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.189:40091: Network error: Client connection negotiation failed: client connection to 127.27.41.189:40091: connect: Connection refused (error 111)
W20260810 06:44:57.763824 26839 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 06:44:57.764142 26839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:57.764178 26839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:57.764218 26839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:57.765354 26839 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:57.765429 26839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:57.765460 26839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:57.765491 26839 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:57.765514 26839 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:57.767040 26839 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:35651,127.27.41.189:40091,127.27.41.188:43091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.189.keytab
--principal=kudu/127.27.41.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.189:40091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.41.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:57.767324 26839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:57.767560 26839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:57.772414 26848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:57.772465 26846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:57.772415 26845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:57.772666 26839 server_base.cc:1034] running on GCE node
I20260810 06:44:57.772970 26839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:57.773281 26839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:57.774425 26839 hybrid_clock.cc:648] HybridClock initialized: now 1786344297774414 us; error 29 us; skew 500 ppm
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:57.776984 26839 init.cc:377] Logged in from keytab as kudu/127.27.41.189@KRBTEST.COM (short username kudu)
I20260810 06:44:57.777454 26839 webserver.cc:460] Webserver started at http://127.27.41.189:35285/ using document root <none> and password file <none>
I20260810 06:44:57.777702 26839 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:57.777750 26839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:57.777910 26839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:57.778959 26839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/data/instance:
uuid: "82fee0c8495f422e954c353ade892e0d"
format_stamp: "Formatted at 2026-08-10 06:44:57 on dist-test-slave-bw88"
server_key: "44b434a2d666156a201a106cd94d492d"
server_key_iv: "5f93993ffc9bcdc68fe7cbfd75958b10"
server_key_version: "encryptionkey@0"
I20260810 06:44:57.779222 26832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } attempt: 2
I20260810 06:44:57.779361 26839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/wal/instance:
uuid: "82fee0c8495f422e954c353ade892e0d"
format_stamp: "Formatted at 2026-08-10 06:44:57 on dist-test-slave-bw88"
server_key: "44b434a2d666156a201a106cd94d492d"
server_key_iv: "5f93993ffc9bcdc68fe7cbfd75958b10"
server_key_version: "encryptionkey@0"
I20260810 06:44:57.779580 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.779473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:40091 (local address 127.0.0.1:42238)
0810 06:44:57.779517 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.779545 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:40091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260810 06:44:57.779866 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.779782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:40091 (local address 127.0.0.1:42244)
0810 06:44:57.779824 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.779846 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.189:40091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 06:44:57.779953 26832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.189:40091: Network error: Client connection negotiation failed: client connection to 127.27.41.189:40091: connect: Connection refused (error 111)
I20260810 06:44:57.780788 26839 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 06:44:57.781535 26857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:57.781700 26839 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 06:44:57.781801 26839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/wal
uuid: "82fee0c8495f422e954c353ade892e0d"
format_stamp: "Formatted at 2026-08-10 06:44:57 on dist-test-slave-bw88"
server_key: "44b434a2d666156a201a106cd94d492d"
server_key_iv: "5f93993ffc9bcdc68fe7cbfd75958b10"
server_key_version: "encryptionkey@0"
I20260810 06:44:57.781873 26839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:57.807252 26839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:57.809710 26839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:57.809877 26839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:57.814023 26839 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.189:40091
I20260810 06:44:57.814060 26922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.189:40091 every 8 connection(s)
I20260810 06:44:57.814445 26839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/data/info.pb
I20260810 06:44:57.815232 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 26839
I20260810 06:44:57.815349 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-1/wal/instance
I20260810 06:44:57.815528 26924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:57.815546 27814 external_mini_cluster.cc:1428] Setting key 6e9e1e88fc4c3f400a303a46f3676307
I20260810 06:44:57.817077 26924 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.189@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.41.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.41.188@KRBTEST.COM" created.
I20260810 06:44:57.826408 26835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.817991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51976 (local address 127.27.41.190:35651)
0810 06:44:57.818057 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:57.818059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:57.818253 (+ 194us) server_negotiation.cc:407] Connection header received
0810 06:44:57.818761 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:57.818763 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:57.818779 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:57.818836 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:57.819455 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.820040 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.821016 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.821237 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.821315 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.823497 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:57.823498 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:57.823499 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:57.823507 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:57.824951 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.825374 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.825375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.825376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.825442 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.825697 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.825698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.825698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.825849 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:57.825927 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:57.826227 (+ 300us) server_negotiation.cc:299] Negotiation successful
0810 06:44:57.826313 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 06:44:57.826651 26927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.817926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:35651 (local address 127.0.0.1:51976)
0810 06:44:57.818127 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.818168 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:57.818645 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:57.818902 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:57.818906 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:57.819167 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:57.819359 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.819363 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.820135 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.820136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.820928 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.820930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.821358 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.821360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.821490 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.821982 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:57.821991 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:57.823400 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:57.825056 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.825064 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.825066 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.825282 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.825512 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.825513 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.825514 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.825639 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.825918 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:57.825925 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:57.826089 (+ 164us) client_negotiation.cc:769] Sending connection context
0810 06:44:57.826205 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 06:44:57.826358 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":95,"threads_started":1}
I20260810 06:44:57.827214 26924 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.189@KRBTEST.COM for kudu/127.27.41.189@KRBTEST.COM
I20260810 06:44:57.834708 26928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.827535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42260 (local address 127.27.41.189:40091)
0810 06:44:57.827704 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:57.827708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:57.827734 (+ 26us) server_negotiation.cc:407] Connection header received
0810 06:44:57.827751 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:57.827753 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:57.827763 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:57.827840 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:57.828095 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.828771 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.829496 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.829812 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.829887 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.831956 (+ 2069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:57.831964 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:57.831964 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:57.831970 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:57.833516 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.833903 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.833905 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.833906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.833954 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.834177 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.834177 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.834178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.834302 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:57.834362 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:57.834543 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 06:44:57.834638 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":132,"thread_start_us":90,"threads_started":1}
I20260810 06:44:57.834813 26927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.827490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:40091 (local address 127.0.0.1:42260)
0810 06:44:57.827540 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.827550 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:57.827604 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:57.827840 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:57.827841 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:57.827978 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:57.828021 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.828022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.828860 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.828861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.829404 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.829406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.829895 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.829897 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.829962 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.830405 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:57.830410 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:57.831871 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:57.833595 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.833596 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.833597 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.833826 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.834039 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.834040 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.834040 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.834111 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.834373 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:57.834374 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:57.834429 (+ 55us) client_negotiation.cc:769] Sending connection context
0810 06:44:57.834516 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 06:44:57.834707 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":68}
I20260810 06:44:57.835433 26924 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:44:57.835749 26927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.835660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:43091 (local address 127.0.0.1:51914)
0810 06:44:57.835689 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.835732 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260810 06:44:57.835898 26861 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
I20260810 06:44:57.836288 26927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.836212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:43091 (local address 127.0.0.1:51922)
0810 06:44:57.836250 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.836274 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260810 06:44:57.836403 26924 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:43091: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.41.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.188.keytab.
Entry for principal kudu/127.27.41.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.188.keytab.
I20260810 06:44:57.843571 27814 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyPrKbq/build/release/bin/kudu
/tmp/dist-test-taskyPrKbq/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.188:43091
--webserver_interface=127.27.41.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.188.keytab
--principal=kudu/127.27.41.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.41.148:35031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.41.190:35651,127.27.41.189:40091,127.27.41.188:43091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:44:57.871080 26832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } attempt: 3
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for kudu/127.27.41.189@KRBTEST.COM
I20260810 06:44:57.878175 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.871430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:40091 (local address 127.0.0.1:42268)
0810 06:44:57.871490 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.871508 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:57.871565 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:57.871734 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:57.871735 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:57.871905 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:57.871976 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.871978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.872658 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.872659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.873196 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.873198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.873666 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.873667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.873750 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.874228 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:57.874233 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:57.875662 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:57.877174 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.877175 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.877176 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.877380 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.877555 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.877556 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.877556 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.877622 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.877940 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:57.877941 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:57.877980 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 06:44:57.878031 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 06:44:57.878107 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 06:44:57.878244 26928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.871521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42268 (local address 127.27.41.189:40091)
0810 06:44:57.871608 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:57.871610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:57.871620 (+ 10us) server_negotiation.cc:407] Connection header received
0810 06:44:57.871653 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:57.871654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:57.871665 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:57.871727 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:57.872062 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.872566 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.873280 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.873576 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.873657 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.875748 (+ 2091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:57.875750 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:57.875750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:57.875759 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:57.877084 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.877437 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.877438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.877439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.877492 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.877702 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.877704 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.877704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.877866 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:57.877950 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:57.878074 (+ 124us) server_negotiation.cc:299] Negotiation successful
0810 06:44:57.878157 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 06:44:57.879494 26832 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:44:57.879871 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.879772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:43091 (local address 127.0.0.1:51932)
0810 06:44:57.879820 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.879847 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 06:44:57.880228 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.880150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:43091 (local address 127.0.0.1:51938)
0810 06:44:57.880191 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.880215 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 06:44:57.880336 26832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:43091: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
I20260810 06:44:57.885581 26924 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } attempt: 1
I20260810 06:44:57.885921 26927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.885812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:43091 (local address 127.0.0.1:51944)
0810 06:44:57.885862 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.885895 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 06:44:57.886252 26927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.886163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:43091 (local address 127.0.0.1:51958)
0810 06:44:57.886206 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.886233 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 06:44:57.886341 26924 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:43091: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
I20260810 06:44:57.911461 26832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } attempt: 1
I20260810 06:44:57.911936 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.911810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:43091 (local address 127.0.0.1:51960)
0810 06:44:57.911872 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.911910 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 06:44:57.912317 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.912240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:43091 (local address 127.0.0.1:51976)
0810 06:44:57.912279 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.912303 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260810 06:44:57.912421 26832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:43091: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
W20260810 06:44:57.928921 26932 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 06:44:57.929167 26932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:44:57.929198 26932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:44:57.929252 26932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:44:57.930408 26932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:44:57.930469 26932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:44:57.930493 26932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:44:57.930522 26932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:44:57.930543 26932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:44:57.931989 26932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.41.148:35031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.41.190:35651,127.27.41.189:40091,127.27.41.188:43091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/krb5kdc/kudu_127.27.41.188.keytab
--principal=kudu/127.27.41.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.41.188:43091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.41.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 05:47:10 UTC on ccycloud.quasar-gieubf.root.comops.site
build id 4577114
I20260810 06:44:57.932265 26932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:44:57.932475 26932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:44:57.937245 26943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:57.937266 26939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:44:57.937268 26937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:44:57.937678 26932 server_base.cc:1034] running on GCE node
I20260810 06:44:57.937963 26932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:44:57.938239 26932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:44:57.939412 26932 hybrid_clock.cc:648] HybridClock initialized: now 1786344297939399 us; error 26 us; skew 500 ppm
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:44:57.942018 26932 init.cc:377] Logged in from keytab as kudu/127.27.41.188@KRBTEST.COM (short username kudu)
I20260810 06:44:57.942447 26932 webserver.cc:460] Webserver started at http://127.27.41.188:35713/ using document root <none> and password file <none>
I20260810 06:44:57.942691 26932 fs_manager.cc:359] Metadata directory not provided
I20260810 06:44:57.942759 26932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:44:57.942904 26932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:44:57.943958 26932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/data/instance:
uuid: "a1a2b963fed84eaf9d6a816601df8eb4"
format_stamp: "Formatted at 2026-08-10 06:44:57 on dist-test-slave-bw88"
server_key: "5ab349c69b6c37953ed55c95d9ce129c"
server_key_iv: "36a8a5400fb3699a92ab585d1d6c3099"
server_key_version: "encryptionkey@0"
I20260810 06:44:57.944317 26932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/wal/instance:
uuid: "a1a2b963fed84eaf9d6a816601df8eb4"
format_stamp: "Formatted at 2026-08-10 06:44:57 on dist-test-slave-bw88"
server_key: "5ab349c69b6c37953ed55c95d9ce129c"
server_key_iv: "36a8a5400fb3699a92ab585d1d6c3099"
server_key_version: "encryptionkey@0"
I20260810 06:44:57.945709 26932 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 06:44:57.946415 26957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:44:57.946589 26932 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 06:44:57.946698 26932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/data,/tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/wal
uuid: "a1a2b963fed84eaf9d6a816601df8eb4"
format_stamp: "Formatted at 2026-08-10 06:44:57 on dist-test-slave-bw88"
server_key: "5ab349c69b6c37953ed55c95d9ce129c"
server_key_iv: "36a8a5400fb3699a92ab585d1d6c3099"
server_key_version: "encryptionkey@0"
I20260810 06:44:57.946768 26932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:44:57.954465 26924 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } attempt: 2
I20260810 06:44:57.954877 26927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.954757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:43091 (local address 127.0.0.1:51992)
0810 06:44:57.954813 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.954850 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 06:44:57.955191 26927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.955096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:43091 (local address 127.0.0.1:52004)
0810 06:44:57.955138 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.955163 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 06:44:57.955277 26924 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.41.188:43091: Network error: Client connection negotiation failed: client connection to 127.27.41.188:43091: connect: Connection refused (error 111)
I20260810 06:44:57.969173 26932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:44:57.971218 26932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:44:57.971374 26932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:44:57.975366 26932 rpc_server.cc:307] RPC server started. Bound to: 127.27.41.188:43091
I20260810 06:44:57.975402 27032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.41.188:43091 every 8 connection(s)
I20260810 06:44:57.975797 26932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/data/info.pb
I20260810 06:44:57.976781 27034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:44:57.978463 27034 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:44:57.979050 27814 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyPrKbq/build/release/bin/kudu as pid 26932
I20260810 06:44:57.979175 27814 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyPrKbq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786344020082892-27814-0/minicluster-data/master-2/wal/instance
I20260810 06:44:57.979386 27814 external_mini_cluster.cc:1428] Setting key 709963ecb1461dbf14ff76bff3e438b6
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.188@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.188@KRBTEST.COM
I20260810 06:44:57.987586 26832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } attempt: 2
I20260810 06:44:57.988619 26835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.979190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51978 (local address 127.27.41.190:35651)
0810 06:44:57.979250 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:57.979253 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:57.979498 (+ 245us) server_negotiation.cc:407] Connection header received
0810 06:44:57.980211 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:57.980212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:57.980221 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:57.980268 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:57.980858 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.981448 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.982614 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.982909 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.982972 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.985492 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:57.985493 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:57.985494 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:57.985506 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:57.987021 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.987440 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.987442 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.987443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.987511 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.987857 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.987858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.987859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.988013 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:57.988106 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:57.988443 (+ 337us) server_negotiation.cc:299] Negotiation successful
0810 06:44:57.988537 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 06:44:57.988847 27036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.979181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.190:35651 (local address 127.0.0.1:51978)
0810 06:44:57.979361 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.979403 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:57.980091 (+ 688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:57.980299 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:57.980304 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:57.980613 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:57.980770 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.980775 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.981515 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.981516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.982539 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.982541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.983014 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.983015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.983162 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.983744 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:57.983752 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:57.985397 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:57.987101 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.987108 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.987110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.987360 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.987625 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.987626 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.987627 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.987784 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.988107 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:57.988115 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:57.988291 (+ 176us) client_negotiation.cc:769] Sending connection context
0810 06:44:57.988405 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 06:44:57.988568 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":111,"thread_start_us":105,"threads_started":1}
I20260810 06:44:57.989408 27034 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:44:57.989939 27038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.979937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52014 (local address 127.27.41.188:43091)
0810 06:44:57.980106 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:57.980111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:57.980146 (+ 35us) server_negotiation.cc:407] Connection header received
0810 06:44:57.980224 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:57.980226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:57.980245 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:57.980343 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:57.980996 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.982126 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.982975 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.983402 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.983459 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.986098 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:57.986106 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:57.986106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:57.986118 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:57.988192 (+ 2074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.988623 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.988626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.988626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.988715 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.989034 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.989035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.989035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.989203 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:57.989374 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:57.989785 (+ 411us) server_negotiation.cc:299] Negotiation successful
0810 06:44:57.989868 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.190@KRBTEST.COM for kudu/127.27.41.188@KRBTEST.COM
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.188@KRBTEST.COM for kudu/127.27.41.189@KRBTEST.COM
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.190@KRBTEST.COM
I20260810 06:44:57.996775 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.987842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:43091 (local address 127.0.0.1:52018)
0810 06:44:57.987937 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.987947 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:57.987985 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:57.988244 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:57.988245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:57.988402 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:57.988448 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.988449 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.989771 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.989772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.990534 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.990537 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.991005 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.991005 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.991070 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.991498 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:57.991503 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:57.993027 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:57.995774 (+ 2747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.995775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.995776 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.995952 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.996152 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.996153 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.996154 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.996216 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.996465 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:57.996466 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:57.996510 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 06:44:57.996580 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 06:44:57.996679 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260810 06:44:57.996945 27039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.987940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52018 (local address 127.27.41.188:43091)
0810 06:44:57.988121 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:57.988122 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:57.988128 (+ 6us) server_negotiation.cc:407] Connection header received
0810 06:44:57.988145 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:57.988146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:57.988156 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:57.988224 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:57.988541 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.989669 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.990629 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.990936 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.991009 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.993113 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:57.993114 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:57.993115 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:57.993120 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:57.995697 (+ 2577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.996024 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.996026 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.996026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.996093 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.996285 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.996286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.996287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.996398 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:57.996608 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:57.996650 (+ 42us) server_negotiation.cc:299] Negotiation successful
0810 06:44:57.996722 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":104,"threads_started":1}
I20260810 06:44:57.997628 27036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.989661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.189:40091 (local address 127.0.0.1:42272)
0810 06:44:57.989709 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:57.989718 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:57.989753 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:57.989995 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:57.989996 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:57.990311 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:57.990366 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.990368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.991100 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.991101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.991810 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:57.991813 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.992359 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.992359 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:57.992434 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.992809 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:57.992814 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:57.994200 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:57.996122 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.996124 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.996124 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.996664 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.996919 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:57.996920 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:57.996920 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:57.996978 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:57.997280 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:57.997280 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:57.997323 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 06:44:57.997421 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 06:44:57.997515 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 06:44:57.997663 26928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.989734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42272 (local address 127.27.41.189:40091)
0810 06:44:57.989876 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:57.989878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:57.989885 (+ 7us) server_negotiation.cc:407] Connection header received
0810 06:44:57.989910 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:57.989911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:57.989920 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:57.989976 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:57.990439 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.991004 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.991911 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.992236 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.992277 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.994312 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:57.994314 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:57.994315 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:57.994322 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:57.996027 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.996763 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.996765 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.996765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.996830 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.997059 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.997060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.997060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.997187 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:57.997229 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:57.997455 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 06:44:57.997543 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260810 06:44:57.998672 26832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58: Bootstrap starting.
I20260810 06:44:57.998795 26835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.990774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51984 (local address 127.27.41.190:35651)
0810 06:44:57.990813 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:57.990815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:57.990838 (+ 23us) server_negotiation.cc:407] Connection header received
0810 06:44:57.990855 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:57.990856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:57.990864 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:57.990905 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:57.991551 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.991964 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.992631 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:57.992888 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:57.993026 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:57.995326 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:57.995328 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:57.995328 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:57.995334 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:57.997660 (+ 2326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.997982 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.997983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.997983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.998061 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:57.998259 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:57.998260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:57.998260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:57.998364 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:57.998520 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:57.998583 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 06:44:57.998659 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 06:44:57.999450 26832 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:57.999768 26832 log.cc:824] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:58.000298 27034 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:44:58.001019 26832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58: No bootstrap required, opened a new log
I20260810 06:44:58.003060 26832 raft_consensus.cc:348] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } }
I20260810 06:44:58.003219 26832 raft_consensus.cc:729] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d682bc0eb842049adfd4884571da58, State: Initialized, Role: FOLLOWER
I20260810 06:44:58.003328 26832 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } }
I20260810 06:44:58.003706 26832 sys_catalog.cc:564] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [sys.catalog]: configured and running, proceeding with master startup.
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.41.189@KRBTEST.COM
Aug 10 06:44:57 dist-test-slave-bw88 krb5kdc[26721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.188@KRBTEST.COM for kudu/127.27.41.188@KRBTEST.COM
I20260810 06:44:58.005842 27041 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } } }
I20260810 06:44:58.006074 27041 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 06:44:58.006408 27058 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:44:58.006493 27058 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:44:58.008416 27036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:58.000561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:43091 (local address 127.0.0.1:52020)
0810 06:44:58.000740 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:58.000750 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:58.000793 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:58.000927 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:58.000928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:58.001085 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:58.001119 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:58.001120 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.001990 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.001991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:58.002772 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:58.002776 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.003441 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.003442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:58.003497 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:58.003900 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:58.003905 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:58.005393 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:58.007254 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:58.007255 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:58.007256 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:58.007470 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:58.007692 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:58.007692 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:58.007693 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:58.007745 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:58.008134 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:58.008135 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:58.008176 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 06:44:58.008235 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 06:44:58.008323 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163}
I20260810 06:44:58.008822 26928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:57.999459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42278 (local address 127.27.41.189:40091)
0810 06:44:57.999501 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:57.999503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:57.999512 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:44:57.999541 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:57.999541 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:57.999552 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:57.999628 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.000036 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.000653 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.001572 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.001789 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.001871 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:58.004406 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:58.004408 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:58.004408 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:58.004415 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:58.006983 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:58.007452 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:58.007453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:58.007453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:58.007511 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:58.007737 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:58.007738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:58.007738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:58.007875 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:58.008010 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:58.008384 (+ 374us) server_negotiation.cc:299] Negotiation successful
0810 06:44:58.008725 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 06:44:58.008901 27039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:58.000609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52020 (local address 127.27.41.188:43091)
0810 06:44:58.000667 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.000669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.000798 (+ 129us) server_negotiation.cc:407] Connection header received
0810 06:44:58.000843 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.000844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.000853 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.000913 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.001231 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.001915 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.002872 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.003196 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.003393 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:58.005493 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:58.005494 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:58.005494 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:58.005501 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:58.007167 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:58.007544 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:58.007545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:58.007545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:58.007613 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:58.007808 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:58.007809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:58.007809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:58.007995 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:58.008069 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:58.008678 (+ 609us) server_negotiation.cc:299] Negotiation successful
0810 06:44:58.008804 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 06:44:58.006544 26735 master_runner.cc:186] Error getting master registration for 127.27.41.189:40091: OK, instance_id { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" instance_seqno: 1786344297812792 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 06:44:58.009581 26735 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:44:58.010540 27814 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:44:58.010644 27034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4: Bootstrap starting.
I20260810 06:44:58.011399 27034 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:58.011512 26795 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b9d682bc0eb842049adfd4884571da58"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51984
I20260810 06:44:58.011636 26795 raft_consensus.cc:482] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 06:44:58.011673 27034 log.cc:824] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:58.011683 26795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:58.012444 27034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4: No bootstrap required, opened a new log
I20260810 06:44:58.012562 26795 raft_consensus.cc:504] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } }
I20260810 06:44:58.012816 26795 leader_election.cc:288] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [CANDIDATE]: Term 1 election: Requested vote from peers 82fee0c8495f422e954c353ade892e0d (127.27.41.189:40091), a1a2b963fed84eaf9d6a816601df8eb4 (127.27.41.188:43091)
I20260810 06:44:58.014933 27034 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } }
I20260810 06:44:58.015098 27034 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a2b963fed84eaf9d6a816601df8eb4, State: Initialized, Role: FOLLOWER
I20260810 06:44:58.015204 27034 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } }
I20260810 06:44:58.015519 27034 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:44:58.015512 27069 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } } }
I20260810 06:44:58.015581 26993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b9d682bc0eb842049adfd4884571da58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a1a2b963fed84eaf9d6a816601df8eb4"
I20260810 06:44:58.015733 27069 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:44:58.015770 26993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:58.017282 26993 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d682bc0eb842049adfd4884571da58 in term 1.
I20260810 06:44:58.017565 26761 leader_election.cc:302] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a2b963fed84eaf9d6a816601df8eb4, b9d682bc0eb842049adfd4884571da58; no voters:
I20260810 06:44:58.017727 27041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:44:58.017884 27041 raft_consensus.cc:686] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [term 1 LEADER]: Becoming Leader. State: Replica: b9d682bc0eb842049adfd4884571da58, State: Running, Role: LEADER
I20260810 06:44:58.017973 27041 consensus_queue.cc:237] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } }
I20260810 06:44:58.018435 27041 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9d682bc0eb842049adfd4884571da58. Latest consensus state: current_term: 1 leader_uuid: "b9d682bc0eb842049adfd4884571da58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } } }
I20260810 06:44:58.018544 27041 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [sys.catalog]: This master's current role is: LEADER
W20260810 06:44:58.018661 27085 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:44:58.018749 27085 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:44:58.020216 26932 master_runner.cc:186] Error getting master registration for 127.27.41.189:40091: OK, instance_id { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" instance_seqno: 1786344297812792 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 06:44:58.022830 26932 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:44:58.030272 26835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:58.014193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51992 (local address 127.27.41.190:35651)
0810 06:44:58.014244 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.014247 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.021522 (+ 7275us) server_negotiation.cc:407] Connection header received
0810 06:44:58.021606 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.021608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.021620 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.021681 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.022994 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.023659 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.024716 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.025029 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.025072 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:58.026846 (+ 1774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:58.026848 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:58.026848 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:58.026857 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:58.028621 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:58.029062 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:58.029063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:58.029063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:58.029136 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:58.029390 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:58.029391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:58.029391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:58.029545 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:58.029671 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:58.030079 (+ 408us) server_negotiation.cc:299] Negotiation successful
0810 06:44:58.030172 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 06:44:58.031205 27089 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:44:58.031446 27089 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:44:58.033512 26993 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4 [term 1 FOLLOWER]: Refusing update from remote peer b9d682bc0eb842049adfd4884571da58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:58.033937 27041 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:58.035176 27039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:58.013927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52034 (local address 127.27.41.188:43091)
0810 06:44:58.014136 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.014138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.021696 (+ 7558us) server_negotiation.cc:407] Connection header received
0810 06:44:58.021795 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.021796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.021806 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.021834 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.022585 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.023280 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.024278 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.024586 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.024652 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:58.031688 (+ 7036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:58.031690 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:58.031690 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:58.031698 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:58.033406 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:58.033997 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:58.033998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:58.033999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:58.034078 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:58.034379 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:58.034380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:58.034381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:58.034526 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:58.034632 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:58.034980 (+ 348us) server_negotiation.cc:299] Negotiation successful
0810 06:44:58.035082 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185}
I20260810 06:44:58.035948 27069 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9d682bc0eb842049adfd4884571da58. Latest consensus state: current_term: 1 leader_uuid: "b9d682bc0eb842049adfd4884571da58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } } }
I20260810 06:44:58.036053 27069 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:44:58.041429 26928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:58.014257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42294 (local address 127.27.41.189:40091)
0810 06:44:58.014295 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.014297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.029723 (+ 15426us) server_negotiation.cc:407] Connection header received
0810 06:44:58.029863 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.029864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.029877 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.029948 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.032391 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.033161 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.034259 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.034583 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.034629 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:58.038385 (+ 3756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:58.038386 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:58.038387 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:58.038395 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:58.040128 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:58.040530 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:58.040532 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:58.040532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:58.040604 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:58.040812 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:58.040812 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:58.040813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:58.040945 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:58.041045 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:58.041214 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 06:44:58.041304 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 06:44:58.046399 26924 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } attempt: 3
I20260810 06:44:58.046689 27041 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b9d682bc0eb842049adfd4884571da58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } } }
I20260810 06:44:58.046811 27041 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:58.047396 27069 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b9d682bc0eb842049adfd4884571da58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } } }
I20260810 06:44:58.047487 27069 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:44:58.047720 27090 mvcc.cc:205] Tried to move back new op lower bound from 7316866244742508544 to 7316866244682461184. Current Snapshot: MvccSnapshot[applied={T|T < 7316866244742508544}]
I20260810 06:44:58.048502 27089 catalog_manager.cc:1347] Generated new cluster ID: 7452f74de12e41c49ed29d351d8ddd94
I20260810 06:44:58.048555 27089 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 06:44:58 dist-test-slave-bw88 krb5kdc[26721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786344297, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.41.189@KRBTEST.COM for kudu/127.27.41.188@KRBTEST.COM
I20260810 06:44:58.054049 26927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:58.046655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.41.188:43091 (local address 127.0.0.1:52046)
0810 06:44:58.046748 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0810 06:44:58.046759 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:44:58.046798 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:44:58.046949 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:44:58.046950 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:44:58.047112 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:44:58.047158 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:58.047160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.048154 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.048155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:58.048910 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:44:58.048913 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.049404 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.049405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:44:58.049463 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:58.049891 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:44:58.049895 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:44:58.051303 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:44:58.052976 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:58.052977 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:58.052978 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:58.053166 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:58.053366 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:44:58.053367 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:44:58.053367 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:44:58.053432 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:44:58.053737 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:44:58.053738 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:44:58.053784 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 06:44:58.053848 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 06:44:58.053952 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260810 06:44:58.054363 27039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:58.046764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52046 (local address 127.27.41.188:43091)
0810 06:44:58.046818 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.046820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.046860 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:44:58.046881 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.046882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.046892 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.046945 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.047250 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.047945 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.049014 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:58.049293 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:58.049352 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:58.051387 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:44:58.051388 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:44:58.051389 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:44:58.051395 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:44:58.052893 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:58.053237 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:58.053237 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:58.053238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:58.053286 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:44:58.053515 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:44:58.053516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:44:58.053516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:44:58.053644 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:44:58.053709 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:58.054210 (+ 501us) server_negotiation.cc:299] Negotiation successful
0810 06:44:58.054282 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 06:44:58.055714 26924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d: Bootstrap starting.
I20260810 06:44:58.056403 26924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d: Neither blocks nor log segments found. Creating new log.
I20260810 06:44:58.056713 26924 log.cc:824] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d: Log is configured to *not* fsync() on all Append() calls
I20260810 06:44:58.057806 26924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d: No bootstrap required, opened a new log
I20260810 06:44:58.059875 26924 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } }
I20260810 06:44:58.060003 26924 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82fee0c8495f422e954c353ade892e0d, State: Initialized, Role: FOLLOWER
I20260810 06:44:58.060089 26924 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } }
I20260810 06:44:58.060427 26924 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d [sys.catalog]: configured and running, proceeding with master startup.
W20260810 06:44:58.060650 26863 tablet.cc:2369] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:44:58.061424 26887 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:44:58.062325 26887 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d [term 1 FOLLOWER]: Refusing update from remote peer b9d682bc0eb842049adfd4884571da58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:44:58.062503 26888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b9d682bc0eb842049adfd4884571da58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "82fee0c8495f422e954c353ade892e0d"
I20260810 06:44:58.063638 26888 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d682bc0eb842049adfd4884571da58 in term 1.
I20260810 06:44:58.064029 27041 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:44:58.069443 27114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b9d682bc0eb842049adfd4884571da58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } } }
I20260810 06:44:58.069453 27097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9d682bc0eb842049adfd4884571da58. Latest consensus state: current_term: 1 leader_uuid: "b9d682bc0eb842049adfd4884571da58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } } }
I20260810 06:44:58.069614 27114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:44:58.069622 27097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:44:58.069689 27114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b9d682bc0eb842049adfd4884571da58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } } }
I20260810 06:44:58.069739 27114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:44:58.069932 27115 mvcc.cc:205] Tried to move back new op lower bound from 7316866244742508544 to 7316866244682461184. Current Snapshot: MvccSnapshot[applied={T|T < 7316866244742508544}]
W20260810 06:44:58.070294 27113 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:44:58.070389 27113 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:44:58.076695 27041 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b9d682bc0eb842049adfd4884571da58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9d682bc0eb842049adfd4884571da58" member_type: VOTER last_known_addr { host: "127.27.41.190" port: 35651 } } peers { permanent_uuid: "82fee0c8495f422e954c353ade892e0d" member_type: VOTER last_known_addr { host: "127.27.41.189" port: 40091 } } peers { permanent_uuid: "a1a2b963fed84eaf9d6a816601df8eb4" member_type: VOTER last_known_addr { host: "127.27.41.188" port: 43091 } } }
I20260810 06:44:58.076803 27041 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58 [sys.catalog]: This master's current role is: LEADER
I20260810 06:44:58.078827 27089 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:44:58.079545 27089 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:44:58.089432 27089 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b9d682bc0eb842049adfd4884571da58: Generated new TSK 0
I20260810 06:44:58.089659 27089 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 06:44:58.120314 27039 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:58.118581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52060 (local address 127.27.41.188:43091)
0810 06:44:58.118632 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.118635 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.119613 (+ 978us) server_negotiation.cc:407] Connection header received
0810 06:44:58.119730 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.119731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.119743 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.119773 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.120251 (+ 478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52060: BlockingRecv error: recv got EOF from 127.0.0.1:52060 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260810 06:44:58.121107 26928 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:58.119000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42298 (local address 127.27.41.189:40091)
0810 06:44:58.119041 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.119044 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.120570 (+ 1526us) server_negotiation.cc:407] Connection header received
0810 06:44:58.120670 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.120671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.120683 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.120716 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.121047 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42298: BlockingRecv error: recv got EOF from 127.0.0.1:42298 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 06:44:58.121948 26835 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:58.119344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52004 (local address 127.27.41.190:35651)
0810 06:44:58.119382 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.119384 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.121397 (+ 2013us) server_negotiation.cc:407] Connection header received
0810 06:44:58.121538 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.121540 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.121551 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.121582 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.121887 (+ 305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52004: BlockingRecv error: recv got EOF from 127.0.0.1:52004 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 06:44:58.124461 26928 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:58.123697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42300 (local address 127.27.41.189:40091)
0810 06:44:58.123742 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.123744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.123944 (+ 200us) server_negotiation.cc:407] Connection header received
0810 06:44:58.124062 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.124063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.124082 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.124111 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.124418 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42300: BlockingRecv error: recv got EOF from 127.0.0.1:42300 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260810 06:44:58.127383 26928 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:58.126663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42316 (local address 127.27.41.189:40091)
0810 06:44:58.126705 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.126707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.126920 (+ 213us) server_negotiation.cc:407] Connection header received
0810 06:44:58.127023 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.127023 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.127034 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.127061 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.127344 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42316: BlockingRecv error: recv got EOF from 127.0.0.1:42316 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260810 06:44:58.131227 26928 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:58.130455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42318 (local address 127.27.41.189:40091)
0810 06:44:58.130488 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.130490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.130721 (+ 231us) server_negotiation.cc:407] Connection header received
0810 06:44:58.130819 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.130820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.130830 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.130859 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.131188 (+ 329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42318: BlockingRecv error: recv got EOF from 127.0.0.1:42318 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260810 06:44:58.137205 26928 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:58.136401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42334 (local address 127.27.41.189:40091)
0810 06:44:58.136436 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.136438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.136682 (+ 244us) server_negotiation.cc:407] Connection header received
0810 06:44:58.136782 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.136783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.136793 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.136822 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.137164 (+ 342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42334: BlockingRecv error: recv got EOF from 127.0.0.1:42334 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 06:44:58.147387 26928 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:58.146483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42336 (local address 127.27.41.189:40091)
0810 06:44:58.146525 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.146527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.146791 (+ 264us) server_negotiation.cc:407] Connection header received
0810 06:44:58.146907 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.146908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.146931 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.146962 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.147333 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42336: BlockingRecv error: recv got EOF from 127.0.0.1:42336 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 06:44:58.165934 26928 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:58.164845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42346 (local address 127.27.41.189:40091)
0810 06:44:58.164890 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.164893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.165201 (+ 308us) server_negotiation.cc:407] Connection header received
0810 06:44:58.165312 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.165313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.165326 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.165434 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.165861 (+ 427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42346: BlockingRecv error: recv got EOF from 127.0.0.1:42346 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 06:44:58.200073 26928 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:58.199323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42360 (local address 127.27.41.189:40091)
0810 06:44:58.199372 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.199374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.199498 (+ 124us) server_negotiation.cc:407] Connection header received
0810 06:44:58.199578 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.199580 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.199595 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.199647 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.199998 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42360: BlockingRecv error: recv got EOF from 127.0.0.1:42360 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260810 06:44:58.265949 26928 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:58.265201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42372 (local address 127.27.41.189:40091)
0810 06:44:58.265293 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.265295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.265386 (+ 91us) server_negotiation.cc:407] Connection header received
0810 06:44:58.265481 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.265482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.265494 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.265549 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.265890 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42372: BlockingRecv error: recv got EOF from 127.0.0.1:42372 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260810 06:44:58.395923 26928 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:58.395109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42380 (local address 127.27.41.189:40091)
0810 06:44:58.395187 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.395189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.395279 (+ 90us) server_negotiation.cc:407] Connection header received
0810 06:44:58.395376 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.395377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.395390 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.395458 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.395858 (+ 400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42380: BlockingRecv error: recv got EOF from 127.0.0.1:42380 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 06:44:58.654058 26928 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:44:58.653372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42384 (local address 127.27.41.189:40091)
0810 06:44:58.653437 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:58.653439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:58.653468 (+ 29us) server_negotiation.cc:407] Connection header received
0810 06:44:58.653549 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:58.653550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:58.653566 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:58.653630 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:44:58.653980 (+ 350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42384: BlockingRecv error: recv got EOF from 127.0.0.1:42384 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 06:44:59.019229 27085 catalog_manager.cc:1259] Loaded cluster ID: 7452f74de12e41c49ed29d351d8ddd94
I20260810 06:44:59.019310 27085 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4: loading cluster ID for follower catalog manager: success
I20260810 06:44:59.020090 27085 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4: acquiring CA information for follower catalog manager: success
I20260810 06:44:59.020354 27085 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a1a2b963fed84eaf9d6a816601df8eb4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:44:59.070873 27113 catalog_manager.cc:1259] Loaded cluster ID: 7452f74de12e41c49ed29d351d8ddd94
I20260810 06:44:59.070957 27113 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d: loading cluster ID for follower catalog manager: success
I20260810 06:44:59.071772 27113 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d: acquiring CA information for follower catalog manager: success
I20260810 06:44:59.072096 27113 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 82fee0c8495f422e954c353ade892e0d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:44:59.169739 27219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:59.167237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42388 (local address 127.27.41.189:40091)
0810 06:44:59.167388 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:59.167390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:59.167401 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:44:59.167476 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:59.167477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:59.167531 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:59.167620 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:59.167758 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:59.168252 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:59.168979 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:59.169175 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:59.169224 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:59.169395 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:59.169503 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:59.169561 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:59.169600 (+ 39us) server_negotiation.cc:299] Negotiation successful
0810 06:44:59.169618 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
I20260810 06:44:59.173944 27226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:59.171515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52064 (local address 127.27.41.188:43091)
0810 06:44:59.171655 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:59.171657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:59.171666 (+ 9us) server_negotiation.cc:407] Connection header received
0810 06:44:59.171713 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:59.171714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:59.171768 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:59.171849 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:59.171967 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:59.172442 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:59.173119 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:59.173386 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:59.173458 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:59.173622 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:59.173725 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:59.173806 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:59.173832 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 06:44:59.173853 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":64,"threads_started":1}
I20260810 06:44:59.178339 27219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:59.175534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42396 (local address 127.27.41.189:40091)
0810 06:44:59.175677 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:59.175679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:59.175835 (+ 156us) server_negotiation.cc:407] Connection header received
0810 06:44:59.175949 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:59.175950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:59.175963 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:59.176020 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:59.176156 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:59.176629 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:59.177613 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:59.177904 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:59.177974 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:59.178087 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:59.178122 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:59.178171 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:59.178229 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 06:44:59.178251 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260810 06:44:59.178862 27226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:59.175588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52068 (local address 127.27.41.188:43091)
0810 06:44:59.175650 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:59.175652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:59.175835 (+ 183us) server_negotiation.cc:407] Connection header received
0810 06:44:59.175886 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:59.175887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:59.175897 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:59.175944 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:59.176193 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:59.176910 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:59.177940 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:59.178227 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:59.178265 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:59.178560 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:59.178589 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:59.178631 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:59.178755 (+ 124us) server_negotiation.cc:299] Negotiation successful
0810 06:44:59.178801 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 06:44:59.178918 27234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:44:59.175549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52016 (local address 127.27.41.190:35651)
0810 06:44:59.175728 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 06:44:59.175730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 06:44:59.175745 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:44:59.175836 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:44:59.175837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:44:59.175891 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:44:59.175967 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:44:59.176194 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:59.176939 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:59.177900 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:44:59.178243 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:44:59.178303 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:44:59.178541 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:44:59.178645 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:44:59.178703 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:44:59.178807 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 06:44:59.178834 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":67,"threads_started":1}
I20260810 06:44:59.180459 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 26735
I20260810 06:44:59.190856 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 26839
I20260810 06:44:59.202562 27814 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyPrKbq/build/release/bin/kudu with pid 26932
2026-08-10T06:44:59Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3019 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6024 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (279130 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST